Oct 20 14:26:18 user nova-compute[76870]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=76870) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=76870) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=76870) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 14:26:18 user nova-compute[76870]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:26:18 user nova-compute[76870]: INFO nova.virt.driver [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 14:26:18 user nova-compute[76870]: INFO nova.compute.provider_config [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Acquiring lock "singleton_lock" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Acquired lock "singleton_lock" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Releasing lock "singleton_lock" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Full set of CONF: {{(pid=76870) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ******************************************************************************** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Configuration options gathered from: {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ================================================================================ {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] allow_resize_to_same_host      = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] arq_binding_timeout            = 300 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] backdoor_port                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] backdoor_socket                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] block_device_allocate_retries  = 300 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] block_device_allocate_retries_interval = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cert                           = self.pem {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute_monitors               = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] config_dir                     = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] config_drive_format            = iso9660 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] config_source                  = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] console_host                   = user {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] control_exchange               = nova {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cpu_allocation_ratio           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] daemon                         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] debug                          = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] default_access_ip_network_name = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] default_availability_zone      = nova {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] default_ephemeral_format       = ext4 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] default_green_pool_size        = 1000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] default_schedule_zone          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] disk_allocation_ratio          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] enable_new_services            = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] enabled_apis                   = ['osapi_compute'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] enabled_ssl_apis               = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] flat_injected                  = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:18 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] force_config_drive             = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] force_raw_images               = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] graceful_shutdown_timeout      = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] heal_instance_info_cache_interval = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] host                           = user {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_build_timeout         = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_delete_interval       = 300 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_format                = [instance: %(uuid)s]  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_name_template         = instance-%08x {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_usage_audit           = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_usage_audit_period    = month {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] internal_service_availability_zone = internal {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] key                            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] live_migration_retry_count     = 30 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_config_append              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_dir                        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_file                       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_options                    = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_rotate_interval            = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_rotate_interval_type       = days {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] log_rotation_type              = none {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] long_rpc_timeout               = 1800 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] max_concurrent_builds          = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] max_concurrent_live_migrations = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] max_concurrent_snapshots       = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] max_local_block_devices        = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] max_logfile_count              = 30 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] max_logfile_size_mb            = 200 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] maximum_instance_delete_attempts = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metadata_listen                = 0.0.0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metadata_listen_port           = 8775 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metadata_workers               = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] migrate_max_retries            = -1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] mkisofs_cmd                    = genisoimage {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] my_ip                          = 10.0.0.210 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] network_allocate_retries       = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] osapi_compute_listen_port      = 8774 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] osapi_compute_unique_server_name_scope =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] osapi_compute_workers          = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] password_length                = 12 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] periodic_enable                = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] periodic_fuzzy_delay           = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] pointer_model                  = ps2mouse {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] preallocate_images             = none {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] publish_errors                 = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] pybasedir                      = /opt/stack/nova {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ram_allocation_ratio           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rate_limit_burst               = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rate_limit_except_level        = CRITICAL {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rate_limit_interval            = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reboot_timeout                 = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reclaim_instance_interval      = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] record                         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reimage_timeout_per_gb         = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] report_interval                = 120 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rescue_timeout                 = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reserved_host_cpus             = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reserved_host_disk_mb          = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reserved_host_memory_mb        = 512 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] reserved_huge_pages            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] resize_confirm_window          = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] resize_fs_using_block_device   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] resume_guests_state_on_host_boot = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rpc_response_timeout           = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] run_external_periodic_tasks    = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] running_deleted_instance_action = reap {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] running_deleted_instance_poll_interval = 1800 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] running_deleted_instance_timeout = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler_instance_sync_interval = 120 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_down_time              = 720 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] servicegroup_driver            = db {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] shelved_offload_time           = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] shelved_poll_interval          = 3600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] shutdown_timeout               = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] source_is_ipv6                 = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ssl_only                       = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] state_path                     = /opt/stack/data/nova {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] sync_power_state_interval      = 600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] sync_power_state_pool_size     = 1000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] syslog_log_facility            = LOG_USER {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] tempdir                        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] timeout_nbd                    = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] transport_url                  = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] update_resources_interval      = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_cow_images                 = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_eventlog                   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_journal                    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_json                       = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_rootwrap_daemon            = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_stderr                     = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] use_syslog                     = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vcpu_pin_set                   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plugging_is_fatal          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plugging_timeout           = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] virt_mkfs                      = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] volume_usage_poll_interval     = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] watch_log_file                 = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] web                            = /usr/share/spice-html5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_concurrency.disable_process_locking = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.auth_strategy              = keystone {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.compute_link_prefix        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.dhcp_domain                = novalocal {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.enable_instance_password   = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.glance_link_prefix         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.instance_list_per_project_cells = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.list_records_by_skipping_down_cells = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.local_metadata_per_cell    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.max_limit                  = 1000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.metadata_cache_expiration  = 15 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.neutron_default_tenant_id  = default {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.use_forwarded_for          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.use_neutron_default_nets   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_dynamic_targets = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_jsonfile_path   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.backend                  = dogpile.cache.memcached {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.backend_argument         = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.config_prefix            = cache.oslo {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.dead_timeout             = 60.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.debug_cache_backend      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.enable_retry_client      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.enable_socket_keepalive  = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.enabled                  = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.expiration_time          = 600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.hashclient_retry_attempts = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_dead_retry      = 300 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_password        =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_pool_maxsize    = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_sasl_enabled    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.memcache_username        =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.proxies                  = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.retry_attempts           = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.retry_delay              = 0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.socket_keepalive_count   = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.socket_keepalive_idle    = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.socket_keepalive_interval = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.tls_allowed_ciphers      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.tls_cafile               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.tls_certfile             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.tls_enabled              = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cache.tls_keyfile              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.auth_section            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.auth_type               = password {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.cafile                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.certfile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.collect_timing          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.cross_az_attach         = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.debug                   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.endpoint_template       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.http_retries            = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.insecure                = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.keyfile                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.os_region_name          = RegionOne {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.split_loggers           = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cinder.timeout                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.cpu_dedicated_set      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.cpu_shared_set         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.image_type_exclude_list = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.max_concurrent_disk_ops = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.max_disk_devices_to_attach = -1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.resource_provider_association_refresh = 300 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.shutdown_retry_interval = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] conductor.workers              = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] console.allowed_origins        = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] console.ssl_ciphers            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] console.ssl_minimum_version    = default {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] consoleauth.token_ttl          = 600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.cafile                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.certfile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.collect_timing          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.connect_retries         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.connect_retry_delay     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.endpoint_override       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.insecure                = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.keyfile                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.max_version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.min_version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.region_name             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.service_name            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.service_type            = accelerator {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.split_loggers           = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.status_code_retries     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.timeout                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] cyborg.version                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.backend               = sqlalchemy {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.connection            = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.connection_debug      = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.connection_parameters =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.connection_recycle_time = 3600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.connection_trace      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.db_inc_retry_interval = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.db_max_retries        = 20 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.db_max_retry_interval = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.db_retry_interval     = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.max_overflow          = 50 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.max_pool_size         = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.max_retries           = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.mysql_wsrep_sync_wait = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.pool_timeout          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.retry_interval        = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.slave_connection      = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] database.sqlite_synchronous    = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.backend           = sqlalchemy {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.connection        = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.connection_debug  = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.connection_parameters =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.connection_recycle_time = 3600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.connection_trace  = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.db_inc_retry_interval = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.db_max_retries    = 20 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.db_max_retry_interval = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.db_retry_interval = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.max_overflow      = 50 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.max_pool_size     = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.max_retries       = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.pool_timeout      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.retry_interval    = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.slave_connection  = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] api_database.sqlite_synchronous = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] devices.enabled_mdev_types     = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ephemeral_storage_encryption.enabled = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.api_servers             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.cafile                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.certfile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.collect_timing          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.connect_retries         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.connect_retry_delay     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.debug                   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.default_trusted_certificate_ids = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.enable_certificate_validation = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.enable_rbd_download     = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.endpoint_override       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.insecure                = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.keyfile                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.max_version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.min_version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.num_retries             = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.rbd_ceph_conf           =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.rbd_connect_timeout     = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.rbd_pool                =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.rbd_user                =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.region_name             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.service_name            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.service_type            = image {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.split_loggers           = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.status_code_retries     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.timeout                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.verify_glance_signatures = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] glance.version                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] guestfs.debug                  = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.config_drive_cdrom      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.config_drive_inject_password = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.enable_instance_metrics_collection = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.enable_remotefx         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.instances_path_share    =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.iscsi_initiator_list    = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.limit_cpu_features      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.power_state_check_timeframe = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.use_multipath_io        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.volume_attach_retry_count = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.vswitch_name            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] mks.enabled                    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] image_cache.manager_interval   = 2400 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] image_cache.precache_concurrency = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] image_cache.remove_unused_base_images = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] image_cache.subdirectory_name  = _base {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.api_max_retries         = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.api_retry_interval      = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.auth_section            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.auth_type               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.cafile                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.certfile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.collect_timing          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.conductor_group         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.connect_retries         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.connect_retry_delay     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.endpoint_override       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.insecure                = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.keyfile                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.max_version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.min_version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.peer_list               = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.region_name             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.serial_console_state_timeout = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.service_name            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.service_type            = baremetal {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.split_loggers           = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.status_code_retries     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.timeout                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ironic.version                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] key_manager.fixed_key          = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.barbican_api_version  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.barbican_endpoint     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.barbican_endpoint_type = public {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.barbican_region_name  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.cafile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.certfile              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.collect_timing        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.insecure              = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.keyfile               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.number_of_retries     = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.retry_delay           = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.send_service_user_token = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.split_loggers         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.timeout               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.verify_ssl            = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican.verify_ssl_path       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.auth_section = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.auth_type = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.cafile   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.certfile = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.collect_timing = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.insecure = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.keyfile  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.split_loggers = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] barbican_service_user.timeout  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.approle_role_id          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.approle_secret_id        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.cafile                   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.certfile                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.collect_timing           = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.insecure                 = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.keyfile                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.kv_mountpoint            = secret {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.kv_path                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.kv_version               = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.namespace                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.root_token_id            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.split_loggers            = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.ssl_ca_crt_file          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.timeout                  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.use_ssl                  = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.auth_section          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.auth_type             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.cafile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.certfile              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.collect_timing        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.connect_retries       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.connect_retry_delay   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.endpoint_override     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.insecure              = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.keyfile               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.max_version           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.min_version           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.region_name           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.service_name          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.service_type          = identity {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.split_loggers         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.status_code_retries   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.timeout               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] keystone.version               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.connection_uri         =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_mode               = custom {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: WARNING oslo_config.cfg [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_power_governor_high = performance {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_power_governor_low = powersave {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_power_management   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.device_detach_attempts = 8 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.device_detach_timeout  = 20 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.disk_cachemodes        = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.disk_prefix            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.enabled_perf_events    = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.file_backed_memory     = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.gid_maps               = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.hw_disk_discard        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.hw_machine_type        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_rbd_glance_store_name =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_rbd_pool        = rbd {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_type            = default {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.images_volume_group    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.inject_key             = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.inject_partition       = -2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.inject_password        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.iscsi_iface            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.iser_use_multipath     = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_bandwidth = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_downtime = 500 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_inbound_addr = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_permit_post_copy = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_scheme  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_timeout_action = abort {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_tunnelled = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: WARNING oslo_config.cfg [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 14:26:19 user nova-compute[76870]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 14:26:19 user nova-compute[76870]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 14:26:19 user nova-compute[76870]: and ``live_migration_inbound_addr`` respectively.
Oct 20 14:26:19 user nova-compute[76870]: ).  Its value may be silently ignored in the future.
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.live_migration_with_native_tls = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.max_queues             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.nfs_mount_options      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.num_memory_encrypted_guests = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.num_pcie_ports         = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.pmem_namespaces        = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.quobyte_client_cfg     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rbd_secret_uuid        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rbd_user               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.remote_filesystem_transport = ssh {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rescue_image_id        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rescue_kernel_id       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rescue_ramdisk_id      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.rx_queue_size          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.smbfs_mount_options    =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.snapshot_compression   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.snapshot_image_format  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.sparse_logical_volumes = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.swtpm_enabled          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.swtpm_group            = tss {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.swtpm_user             = tss {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.sysinfo_serial         = unique {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.tb_cache_size          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.tx_queue_size          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.uid_maps               = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.use_virtio_for_bridges = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.virt_type              = kvm {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.volume_clear           = zero {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.volume_clear_size      = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.volume_use_multipath   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_cache_path   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.vzstorage_mount_user   = stack {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.auth_section           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.auth_type              = password {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.cafile                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.certfile               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.collect_timing         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.connect_retries        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.connect_retry_delay    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.default_floating_pool  = public {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.endpoint_override      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.extension_sync_interval = 600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.http_retries           = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.insecure               = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.keyfile                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.max_version            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.min_version            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.ovs_bridge             = br-int {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.physnets               = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.region_name            = RegionOne {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.service_metadata_proxy = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.service_name           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.service_type           = network {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.split_loggers          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.status_code_retries    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.timeout                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] neutron.version                = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] notifications.bdms_in_notifications = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] notifications.default_level    = INFO {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] notifications.notification_format = unversioned {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] notifications.notify_on_state_change = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] pci.alias                      = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] pci.device_spec                = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] pci.report_in_placement        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.auth_section         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.auth_type            = password {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.cafile               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.certfile             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.collect_timing       = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.connect_retries      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.connect_retry_delay  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.default_domain_id    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.default_domain_name  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.domain_id            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.domain_name          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.endpoint_override    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.insecure             = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.keyfile              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.max_version          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.min_version          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.password             = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.project_domain_id    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.project_domain_name  = Default {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.project_id           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.project_name         = service {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.region_name          = RegionOne {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.service_name         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.service_type         = placement {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.split_loggers        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.status_code_retries  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.system_scope         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.timeout              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.trust_id             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.user_domain_id       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.user_domain_name     = Default {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.user_id              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.username             = placement {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] placement.version              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.cores                    = 20 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.count_usage_from_placement = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.injected_file_content_bytes = 10240 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.injected_file_path_length = 255 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.injected_files           = 5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.instances                = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.key_pairs                = 100 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.metadata_items           = 128 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.ram                      = 51200 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.recheck_quota            = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.server_group_members     = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] quota.server_groups            = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rdp.enabled                    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.image_metadata_prefilter = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.max_attempts         = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.max_placement_results = 1000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.query_placement_for_image_type_support = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] scheduler.workers              = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.host_subset_size = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.isolated_hosts = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.isolated_images = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.pci_in_placement = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.track_instance_changes = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metrics.required               = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metrics.weight_multiplier      = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] metrics.weight_setting         = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] serial_console.enabled         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] serial_console.port_range      = 10000:20000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] serial_console.serialproxy_port = 6083 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.auth_section      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.auth_type         = password {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.cafile            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.certfile          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.collect_timing    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.insecure          = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.keyfile           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.send_service_user_token = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.split_loggers     = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] service_user.timeout           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.agent_enabled            = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.enabled                  = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.html5proxy_port          = 6082 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.image_compression        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.jpeg_compression         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.playback_compression     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.server_listen            = 127.0.0.1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.streaming_mode           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] spice.zlib_compression         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] upgrade_levels.baseapi         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] upgrade_levels.cert            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] upgrade_levels.compute         = auto {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] upgrade_levels.conductor       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] upgrade_levels.scheduler       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.auth_section = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.auth_type = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.cafile = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.certfile = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.insecure = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.keyfile = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vendordata_dynamic_auth.timeout = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.api_retry_count         = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.ca_file                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.cache_prefix            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.cluster_name            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.connection_pool_size    = 10 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.console_delay_seconds   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.datastore_regex         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.host_ip                 = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.host_password           = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.host_port               = 443 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.host_username           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.insecure                = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.integration_bridge      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.maximum_objects         = 100 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.pbm_default_policy      = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.pbm_enabled             = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.pbm_wsdl_location       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.serial_port_proxy_uri   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.serial_port_service_uri = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.task_poll_interval      = 0.5 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.use_linked_clone        = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.vnc_keymap              = en-us {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.vnc_port                = 5900 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vmware.vnc_port_total          = 10000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.auth_schemes               = ['none'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.enabled                    = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.novncproxy_port            = 6080 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.server_listen              = 0.0.0.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.vencrypt_ca_certs          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.vencrypt_client_cert       = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vnc.vencrypt_client_key        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.disable_rootwrap   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.enable_numa_live_migration = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.libvirt_disable_apic = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.client_socket_timeout     = 900 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.default_pool_size         = 1000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.keep_alive                = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.max_header_line           = 16384 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.ssl_ca_file               = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.ssl_cert_file             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.ssl_key_file              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.tcp_keepidle              = 600 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] zvm.ca_file                    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] zvm.cloud_connector_url        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] zvm.reachable_timeout          = 300 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.enforce_new_defaults = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.enforce_scope      = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.policy_default_rule = default {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.policy_file        = policy.yaml {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.connection_string     = messaging:// {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.enabled               = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.es_doc_type           = notification {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.es_scroll_size        = 10000 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.es_scroll_time        = 2m {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.filter_error_trace    = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.hmac_keys             = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.sentinel_service_name = mymaster {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.socket_timeout        = 0.1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.trace_requests        = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler.trace_sqlalchemy      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler_jaeger.process_tags   = {} {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler_jaeger.service_name_prefix = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] profiler_otlp.service_name_prefix = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] remote_debug.host              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] remote_debug.port              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.ssl      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_notifications.retry = -1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_messaging_notifications.transport_url = **** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.auth_section        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.auth_type           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.cafile              = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.certfile            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.collect_timing      = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.connect_retries     = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.connect_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.endpoint_id         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.endpoint_override   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.insecure            = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.keyfile             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.max_version         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.min_version         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.region_name         = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.service_name        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.service_type        = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.split_loggers       = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.status_code_retries = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.status_code_retry_delay = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.timeout             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.valid_interfaces    = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_limit.version             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_reports.file_event_handler = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] oslo_reports.log_dir           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_ovs_privileged.group  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] vif_plug_ovs_privileged.user   = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.flat_interface = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.isolate_vif         = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_vif_ovs.per_port_bridge     = False {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] os_brick.lock_path             = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] privsep_osbrick.capabilities   = [21] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] privsep_osbrick.group          = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] privsep_osbrick.helper_command = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] privsep_osbrick.user           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] nova_sys_admin.group           = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] nova_sys_admin.helper_command  = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] nova_sys_admin.user            = None {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG oslo_service.service [None req-8e48fc42-321a-44f3-9a3d-fc037b0b274d None None] ******************************************************************************** {{(pid=76870) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 14:26:19 user nova-compute[76870]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Connecting to libvirt: qemu:///system {{(pid=76870) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fec34136560> {{(pid=76870) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 14:26:19 user nova-compute[76870]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 14:26:19 user nova-compute[76870]: WARNING nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fec34136560> {{(pid=76870) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Starting native event thread {{(pid=76870) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Starting green dispatch thread {{(pid=76870) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Starting connection event dispatch thread {{(pid=76870) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 14:26:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Connection event '1' reason 'None'
Oct 20 14:26:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 14:26:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.mount [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Initialising _HostMountState generation 0 {{(pid=76870) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 14:26:27 user nova-compute[76870]: INFO nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host capabilities <capabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <host>
Oct 20 14:26:27 user nova-compute[76870]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 14:26:27 user nova-compute[76870]:     <cpu>
Oct 20 14:26:27 user nova-compute[76870]:       <arch>x86_64</arch>
Oct 20 14:26:27 user nova-compute[76870]:       <model>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <microcode version='1070'/>
Oct 20 14:26:27 user nova-compute[76870]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='osxsave'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='invtsc'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='rsba'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 14:26:27 user nova-compute[76870]:       <pages unit='KiB' size='4'/>
Oct 20 14:26:27 user nova-compute[76870]:       <pages unit='KiB' size='2048'/>
Oct 20 14:26:27 user nova-compute[76870]:     </cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <power_management>
Oct 20 14:26:27 user nova-compute[76870]:       <suspend_mem/>
Oct 20 14:26:27 user nova-compute[76870]:       <suspend_disk/>
Oct 20 14:26:27 user nova-compute[76870]:       <suspend_hybrid/>
Oct 20 14:26:27 user nova-compute[76870]:     </power_management>
Oct 20 14:26:27 user nova-compute[76870]:     <iommu support='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <migration_features>
Oct 20 14:26:27 user nova-compute[76870]:       <live/>
Oct 20 14:26:27 user nova-compute[76870]:       <uri_transports>
Oct 20 14:26:27 user nova-compute[76870]:         <uri_transport>tcp</uri_transport>
Oct 20 14:26:27 user nova-compute[76870]:         <uri_transport>rdma</uri_transport>
Oct 20 14:26:27 user nova-compute[76870]:       </uri_transports>
Oct 20 14:26:27 user nova-compute[76870]:     </migration_features>
Oct 20 14:26:27 user nova-compute[76870]:     <topology>
Oct 20 14:26:27 user nova-compute[76870]:       <cells num='2'>
Oct 20 14:26:27 user nova-compute[76870]:         <cell id='0'>
Oct 20 14:26:27 user nova-compute[76870]:           <memory unit='KiB'>8189224</memory>
Oct 20 14:26:27 user nova-compute[76870]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 20 14:26:27 user nova-compute[76870]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 14:26:27 user nova-compute[76870]:           <distances>
Oct 20 14:26:27 user nova-compute[76870]:             <sibling id='0' value='10'/>
Oct 20 14:26:27 user nova-compute[76870]:             <sibling id='1' value='20'/>
Oct 20 14:26:27 user nova-compute[76870]:           </distances>
Oct 20 14:26:27 user nova-compute[76870]:           <cpus num='6'>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 14:26:27 user nova-compute[76870]:           </cpus>
Oct 20 14:26:27 user nova-compute[76870]:         </cell>
Oct 20 14:26:27 user nova-compute[76870]:         <cell id='1'>
Oct 20 14:26:27 user nova-compute[76870]:           <memory unit='KiB'>8206460</memory>
Oct 20 14:26:27 user nova-compute[76870]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 20 14:26:27 user nova-compute[76870]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 14:26:27 user nova-compute[76870]:           <distances>
Oct 20 14:26:27 user nova-compute[76870]:             <sibling id='0' value='20'/>
Oct 20 14:26:27 user nova-compute[76870]:             <sibling id='1' value='10'/>
Oct 20 14:26:27 user nova-compute[76870]:           </distances>
Oct 20 14:26:27 user nova-compute[76870]:           <cpus num='6'>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 14:26:27 user nova-compute[76870]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 14:26:27 user nova-compute[76870]:           </cpus>
Oct 20 14:26:27 user nova-compute[76870]:         </cell>
Oct 20 14:26:27 user nova-compute[76870]:       </cells>
Oct 20 14:26:27 user nova-compute[76870]:     </topology>
Oct 20 14:26:27 user nova-compute[76870]:     <cache>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 14:26:27 user nova-compute[76870]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 14:26:27 user nova-compute[76870]:     </cache>
Oct 20 14:26:27 user nova-compute[76870]:     <secmodel>
Oct 20 14:26:27 user nova-compute[76870]:       <model>apparmor</model>
Oct 20 14:26:27 user nova-compute[76870]:       <doi>0</doi>
Oct 20 14:26:27 user nova-compute[76870]:     </secmodel>
Oct 20 14:26:27 user nova-compute[76870]:     <secmodel>
Oct 20 14:26:27 user nova-compute[76870]:       <model>dac</model>
Oct 20 14:26:27 user nova-compute[76870]:       <doi>0</doi>
Oct 20 14:26:27 user nova-compute[76870]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 14:26:27 user nova-compute[76870]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 14:26:27 user nova-compute[76870]:     </secmodel>
Oct 20 14:26:27 user nova-compute[76870]:   </host>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='alpha'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>clipper</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='armv6l'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>spitz</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>nuri</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>kzm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sx1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>z2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>tosa</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>n810</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>n800</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>terrier</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>midway</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>microbit</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>verdex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>highbank</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>akita</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>connex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>collie</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='armv7l'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>spitz</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>nuri</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>kzm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sx1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>z2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>tosa</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>n810</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>n800</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>terrier</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>midway</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>microbit</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>verdex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>highbank</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>akita</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>connex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>collie</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='aarch64'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>spitz</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>nuri</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>kzm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sx1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>z2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>tosa</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>n810</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>n800</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>terrier</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>midway</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>microbit</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>verdex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>highbank</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>akita</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>connex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>collie</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <acpi default='on' toggle='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='cris'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='i686'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>isapc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>microvm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='kvm'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <pae/>
Oct 20 14:26:27 user nova-compute[76870]:       <nonpae/>
Oct 20 14:26:27 user nova-compute[76870]:       <acpi default='on' toggle='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:       <apic default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='m68k'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>an5206</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>q800</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='microblaze'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='microblazeel'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='mips'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='16'>malta</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='mipsel'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='16'>malta</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='mips64'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='16'>malta</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>pica61</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>magnum</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='mips64el'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='16'>malta</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>pica61</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>magnum</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='16'>boston</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='ppc'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mac99</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>40p</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>taihu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='ppc64'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>taihu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>40p</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mac99</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='ppc64le'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>taihu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>40p</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>mac99</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='riscv32'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='8'>spike</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='8'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='riscv64'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='8'>spike</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='8'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='s390x'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='sh4'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>shix</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>r2d</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='sh4eb'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>shix</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>r2d</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='sparc'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>LX</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='sparc64'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>niagara</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='x86_64'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>64</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='1'>isapc</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>microvm</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='kvm'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <acpi default='on' toggle='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:       <apic default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='xtensa'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>sim</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>kc705</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ml605</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx200</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx60</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]:   <guest>
Oct 20 14:26:27 user nova-compute[76870]:     <os_type>hvm</os_type>
Oct 20 14:26:27 user nova-compute[76870]:     <arch name='xtensaeb'>
Oct 20 14:26:27 user nova-compute[76870]:       <wordsize>32</wordsize>
Oct 20 14:26:27 user nova-compute[76870]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='4'>sim</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>kc705</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ml605</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>virt</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx200</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>lx60</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 14:26:27 user nova-compute[76870]:       <domain type='qemu'/>
Oct 20 14:26:27 user nova-compute[76870]:     </arch>
Oct 20 14:26:27 user nova-compute[76870]:     <features>
Oct 20 14:26:27 user nova-compute[76870]:       <cpuselection/>
Oct 20 14:26:27 user nova-compute[76870]:       <deviceboot/>
Oct 20 14:26:27 user nova-compute[76870]:       <disksnapshot default='on' toggle='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     </features>
Oct 20 14:26:27 user nova-compute[76870]:   </guest>
Oct 20 14:26:27 user nova-compute[76870]: </capabilities>
Oct 20 14:26:27 user nova-compute[76870]: 
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-q35-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>i686</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='288'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'/>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='lm'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-i440fx-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>i686</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='255'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'/>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='lm'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ide</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-i440fx-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>i686</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='255'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'/>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='lm'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ide</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-q35-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>i686</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='288'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'/>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='lm'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-q35-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>x86_64</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='288'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>efi</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='invtsc'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='rsba'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-i440fx-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>x86_64</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='255'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>efi</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='invtsc'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='rsba'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ide</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-i440fx-jammy</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>x86_64</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='255'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>efi</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='invtsc'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='rsba'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ide</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 14:26:27 user nova-compute[76870]: <domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 14:26:27 user nova-compute[76870]:   <domain>kvm</domain>
Oct 20 14:26:27 user nova-compute[76870]:   <machine>pc-q35-6.2</machine>
Oct 20 14:26:27 user nova-compute[76870]:   <arch>x86_64</arch>
Oct 20 14:26:27 user nova-compute[76870]:   <vcpu max='288'/>
Oct 20 14:26:27 user nova-compute[76870]:   <iothreads supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:   <os supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='firmware'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>efi</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:     <loader supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>rom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pflash</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='readonly'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='secure'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>yes</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>no</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </loader>
Oct 20 14:26:27 user nova-compute[76870]:   </os>
Oct 20 14:26:27 user nova-compute[76870]:   <cpu>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-passthrough' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='hostPassthroughMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='maximum' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='maximumMigratable'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>on</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>off</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='host-model' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <vendor>Intel</vendor>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ss'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='vmx'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pcid'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='hypervisor'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arat'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='umip'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='md-clear'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='invtsc'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibpb'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='ibrs'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-stibp'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='rsba'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='erms'/>
Oct 20 14:26:27 user nova-compute[76870]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:     <mode name='custom' supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>qemu64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>qemu32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>phenom</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>pentium</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>n270</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm64</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>kvm32</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>coreduo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>core2duo</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>athlon</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Westmere</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Snowridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Skylake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>SandyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Penryn</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G5</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G4</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G3</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Opteron_G2</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Opteron_G1</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>IvyBridge</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Icelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Haswell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Rome</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-Milan</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>EPYC</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Dhyana</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cooperlake</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>Conroe</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='no'>Broadwell</model>
Oct 20 14:26:27 user nova-compute[76870]:       <model usable='yes'>486</model>
Oct 20 14:26:27 user nova-compute[76870]:     </mode>
Oct 20 14:26:27 user nova-compute[76870]:   </cpu>
Oct 20 14:26:27 user nova-compute[76870]:   <memoryBacking supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:     <enum name='sourceType'>
Oct 20 14:26:27 user nova-compute[76870]:       <value>file</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>anonymous</value>
Oct 20 14:26:27 user nova-compute[76870]:       <value>memfd</value>
Oct 20 14:26:27 user nova-compute[76870]:     </enum>
Oct 20 14:26:27 user nova-compute[76870]:   </memoryBacking>
Oct 20 14:26:27 user nova-compute[76870]:   <devices>
Oct 20 14:26:27 user nova-compute[76870]:     <disk supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='diskDevice'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>disk</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cdrom</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>floppy</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>lun</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='bus'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>fdc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sata</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </disk>
Oct 20 14:26:27 user nova-compute[76870]:     <graphics supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='type'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>sdl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vnc</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>spice</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egl-headless</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </graphics>
Oct 20 14:26:27 user nova-compute[76870]:     <video supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='modelType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>cirrus</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>vmvga</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>qxl</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>none</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>bochs</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>ramfb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </video>
Oct 20 14:26:27 user nova-compute[76870]:     <hostdev supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='mode'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>subsystem</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='startupPolicy'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>default</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>mandatory</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>requisite</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>optional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='subsysType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>usb</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>pci</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>scsi</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='capsType'/>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='pciBackend'/>
Oct 20 14:26:27 user nova-compute[76870]:     </hostdev>
Oct 20 14:26:27 user nova-compute[76870]:     <rng supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtio-non-transitional</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>random</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>egd</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>builtin</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </rng>
Oct 20 14:26:27 user nova-compute[76870]:     <filesystem supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='driverType'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>path</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>handle</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>virtiofs</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </filesystem>
Oct 20 14:26:27 user nova-compute[76870]:     <tpm supported='yes'>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='model'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-tis</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>tpm-crb</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:       <enum name='backendModel'>
Oct 20 14:26:27 user nova-compute[76870]:         <value>passthrough</value>
Oct 20 14:26:27 user nova-compute[76870]:         <value>emulator</value>
Oct 20 14:26:27 user nova-compute[76870]:       </enum>
Oct 20 14:26:27 user nova-compute[76870]:     </tpm>
Oct 20 14:26:27 user nova-compute[76870]:   </devices>
Oct 20 14:26:27 user nova-compute[76870]:   <features>
Oct 20 14:26:27 user nova-compute[76870]:     <gic supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:     <vmcoreinfo supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <genid supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backingStoreInput supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <backup supported='yes'/>
Oct 20 14:26:27 user nova-compute[76870]:     <sev supported='no'/>
Oct 20 14:26:27 user nova-compute[76870]:   </features>
Oct 20 14:26:27 user nova-compute[76870]: </domainCapabilities>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=76870) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=76870) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Checking secure boot support for host arch (x86_64) {{(pid=76870) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 14:26:27 user nova-compute[76870]: INFO nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Secure Boot support detected
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] cpu compare xml: <cpu match="exact">
Oct 20 14:26:27 user nova-compute[76870]:   <model>Nehalem</model>
Oct 20 14:26:27 user nova-compute[76870]: </cpu>
Oct 20 14:26:27 user nova-compute[76870]:  {{(pid=76870) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 14:26:27 user nova-compute[76870]: INFO nova.virt.node [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Generated node identity 66693f9b-2ec0-4a94-af95-90fe75f25c06
Oct 20 14:26:27 user nova-compute[76870]: INFO nova.virt.node [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Wrote node identity 66693f9b-2ec0-4a94-af95-90fe75f25c06 to /opt/stack/data/nova/compute_id
Oct 20 14:26:27 user nova-compute[76870]: WARNING nova.compute.manager [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Compute nodes ['66693f9b-2ec0-4a94-af95-90fe75f25c06'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 14:26:27 user nova-compute[76870]: INFO nova.compute.manager [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 14:26:27 user nova-compute[76870]: WARNING nova.compute.manager [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 14:26:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:26:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:26:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Hypervisor/Node resource view: name=user free_ram=10939MB free_disk=26.153141021728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:26:27 user nova-compute[76870]: WARNING nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] No compute node record for user:66693f9b-2ec0-4a94-af95-90fe75f25c06: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 66693f9b-2ec0-4a94-af95-90fe75f25c06 could not be found.
Oct 20 14:26:27 user nova-compute[76870]: INFO nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Compute node record created for user:user with uuid: 66693f9b-2ec0-4a94-af95-90fe75f25c06
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:26:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:26:28 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] [req-8d94ddbb-db3d-4bc2-9722-307b783b3885] Created resource provider record via placement API for resource provider with UUID 66693f9b-2ec0-4a94-af95-90fe75f25c06 and name user.
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=76870) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 14:26:28 user nova-compute[76870]: INFO nova.virt.libvirt.host [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] kernel doesn't support AMD SEV
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Libvirt baseline CPU <cpu>
Oct 20 14:26:28 user nova-compute[76870]:   <arch>x86_64</arch>
Oct 20 14:26:28 user nova-compute[76870]:   <model>Nehalem</model>
Oct 20 14:26:28 user nova-compute[76870]:   <vendor>Intel</vendor>
Oct 20 14:26:28 user nova-compute[76870]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 14:26:28 user nova-compute[76870]: </cpu>
Oct 20 14:26:28 user nova-compute[76870]:  {{(pid=76870) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Updated inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Updating resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 generation from 0 to 1 during operation: update_inventory {{(pid=76870) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Updating resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 generation from 1 to 2 during operation: update_traits {{(pid=76870) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.788s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.service [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Creating RPC server for service compute {{(pid=76870) start /opt/stack/nova/nova/service.py:182}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.service [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] Join ServiceGroup membership for this service compute {{(pid=76870) start /opt/stack/nova/nova/service.py:199}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG nova.servicegroup.drivers.db [None req-ed2f8b08-f6a2-4584-98ad-1ba5199a0288 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=76870) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:26:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:27:18 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:27:18 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:27:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=10382MB free_disk=26.05697250366211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:27:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:27:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:27:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:27:19 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:27:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:27:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:27:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:28:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:28:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:28:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=26.12398910522461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:28:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:28:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:28:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:28:20 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:28:20 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:28:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:28:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:28:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:29:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:29:21 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:29:21 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:29:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=10294MB free_disk=25.876895904541016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:29:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:29:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:29:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:29:22 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:29:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:29:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:29:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:30:22 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:22 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9576MB free_disk=25.903045654296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:30:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:30:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:30:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:30:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:30:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:30:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:30:33 user nova-compute[76870]: INFO nova.compute.claims [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Claim successful on node user
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.network.neutron [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:30:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:30:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Creating image(s)
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "/opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "/opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "/opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:30:34 user nova-compute[76870]: INFO nova.compute.claims [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Claim successful on node user
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.policy [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37fcf98d035d4ed8a6de3a15e78d3318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff7a7bc4204024a9e126a78a8c45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.part --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.virt.images [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] fe361d9c-2878-4d9c-9fb8-7c063759e6e5 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.part /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:30:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:30:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.part /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.converted" returned: 0 in 0.259s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:30:36 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Creating image(s)
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "/opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "/opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "/opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG nova.policy [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5812ebf47e564eedbd34d30333ea45f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0650260e127f4b40863f4c9cdc9bb9f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.499s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:36 user nova-compute[76870]: INFO oslo.privsep.daemon [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5xywcw_h/privsep.sock']
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.071s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:36 user sudo[86119]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5xywcw_h/privsep.sock
Oct 20 14:30:36 user sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 14:30:37 user sudo[86119]: pam_unix(sudo:session): session closed for user root
Oct 20 14:30:37 user nova-compute[76870]: INFO oslo.privsep.daemon [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Spawned new privsep daemon via rootwrap
Oct 20 14:30:37 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 14:30:37 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 14:30:37 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 14:30:37 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86122
Oct 20 14:30:37 user nova-compute[76870]: WARNING oslo_privsep.priv_context [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] privsep daemon already running
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk 1073741824" returned: 0 in 0.042s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.207s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.network.neutron [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Successfully created port: a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk 1073741824" returned: 0 in 0.046s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Cannot resize image /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Ensure instance console log exists: /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.network.neutron [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Successfully created port: acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Cannot resize image /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Ensure instance console log exists: /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:30:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:40 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:30:40 user nova-compute[76870]: INFO nova.compute.claims [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Claim successful on node user
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:30:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:30:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Creating image(s)
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "/opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "/opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "/opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG nova.policy [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e65eb07d084dcb9e5e9188961f4b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8ea9d998b4ba587b16fec8b792c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.219s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk 1073741824" returned: 0 in 0.053s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Successfully updated port: acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquired lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Cannot resize image /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Ensure instance console log exists: /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Successfully updated port: a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquired lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-changed-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Refreshing instance network info cache due to event network-changed-acd2d180-ce3c-4f57-83c1-704e124462a9. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] Acquiring lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.neutron [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updating instance_info_cache with network_info: [{"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Releasing lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Instance network_info: |[{"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] Acquired lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.neutron [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Refreshing network info cache for port acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Start _get_guest_xml network_info=[{"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:30:43 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:43 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-638187570',display_name='tempest-DeleteServersTestJSON-server-638187570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-638187570',id=2,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0650260e127f4b40863f4c9cdc9bb9f2',ramdisk_id='',reservation_id='r-12mg5btq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-681628364',owner_user_name='tempest-DeleteServersTestJSON-681628364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:36Z,user_data=None,user_id='5812ebf47e564eedbd34d30333ea45f2',uuid=d44194ba-73e7-47f2-b2a8-fa157641a48c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Converting VIF {"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.objects.instance [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lazy-loading 'pci_devices' on Instance uuid d44194ba-73e7-47f2-b2a8-fa157641a48c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.neutron [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Successfully created port: fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:30:43 user nova-compute[76870]:   <uuid>d44194ba-73e7-47f2-b2a8-fa157641a48c</uuid>
Oct 20 14:30:43 user nova-compute[76870]:   <name>instance-00000002</name>
Oct 20 14:30:43 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:30:43 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:30:43 user nova-compute[76870]:   <metadata>
Oct 20 14:30:43 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:30:43 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:name>tempest-DeleteServersTestJSON-server-638187570</nova:name>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:30:43</nova:creationTime>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:30:43 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:30:43 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:owner>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:user uuid="5812ebf47e564eedbd34d30333ea45f2">tempest-DeleteServersTestJSON-681628364-project-member</nova:user>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:project uuid="0650260e127f4b40863f4c9cdc9bb9f2">tempest-DeleteServersTestJSON-681628364</nova:project>
Oct 20 14:30:43 user nova-compute[76870]:       </nova:owner>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:ports>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:port uuid="acd2d180-ce3c-4f57-83c1-704e124462a9">
Oct 20 14:30:43 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 14:30:43 user nova-compute[76870]:         </nova:port>
Oct 20 14:30:43 user nova-compute[76870]:       </nova:ports>
Oct 20 14:30:43 user nova-compute[76870]:     </nova:instance>
Oct 20 14:30:43 user nova-compute[76870]:   </metadata>
Oct 20 14:30:43 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:30:43 user nova-compute[76870]:     <system>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="serial">d44194ba-73e7-47f2-b2a8-fa157641a48c</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="uuid">d44194ba-73e7-47f2-b2a8-fa157641a48c</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:30:43 user nova-compute[76870]:     </system>
Oct 20 14:30:43 user nova-compute[76870]:   </sysinfo>
Oct 20 14:30:43 user nova-compute[76870]:   <os>
Oct 20 14:30:43 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:30:43 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:30:43 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:30:43 user nova-compute[76870]:   </os>
Oct 20 14:30:43 user nova-compute[76870]:   <features>
Oct 20 14:30:43 user nova-compute[76870]:     <acpi/>
Oct 20 14:30:43 user nova-compute[76870]:     <apic/>
Oct 20 14:30:43 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:30:43 user nova-compute[76870]:   </features>
Oct 20 14:30:43 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:30:43 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:30:43 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:30:43 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:30:43 user nova-compute[76870]:   </clock>
Oct 20 14:30:43 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:30:43 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:30:43 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:30:43 user nova-compute[76870]:   </cpu>
Oct 20 14:30:43 user nova-compute[76870]:   <devices>
Oct 20 14:30:43 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:30:43 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:30:43 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk"/>
Oct 20 14:30:43 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:30:43 user nova-compute[76870]:     </disk>
Oct 20 14:30:43 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:30:43 user nova-compute[76870]:       <mac address="fa:16:3e:f2:0a:33"/>
Oct 20 14:30:43 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:43 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:30:43 user nova-compute[76870]:       <target dev="tapacd2d180-ce"/>
Oct 20 14:30:43 user nova-compute[76870]:     </interface>
Oct 20 14:30:43 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:30:43 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/console.log" append="off"/>
Oct 20 14:30:43 user nova-compute[76870]:     </serial>
Oct 20 14:30:43 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:30:43 user nova-compute[76870]:     <video>
Oct 20 14:30:43 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:43 user nova-compute[76870]:     </video>
Oct 20 14:30:43 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:30:43 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:30:43 user nova-compute[76870]:     </rng>
Oct 20 14:30:43 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:30:43 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:30:43 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:30:43 user nova-compute[76870]:     </memballoon>
Oct 20 14:30:43 user nova-compute[76870]:   </devices>
Oct 20 14:30:43 user nova-compute[76870]: </domain>
Oct 20 14:30:43 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-638187570',display_name='tempest-DeleteServersTestJSON-server-638187570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-638187570',id=2,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0650260e127f4b40863f4c9cdc9bb9f2',ramdisk_id='',reservation_id='r-12mg5btq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-681628364',owner_user_name='tempest-DeleteServersTestJSON-681628364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:36Z,user_data=None,user_id='5812ebf47e564eedbd34d30333ea45f2',uuid=d44194ba-73e7-47f2-b2a8-fa157641a48c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Converting VIF {"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG os_vif [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Created schema index Interface.name {{(pid=76870) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Created schema index Port.name {{(pid=76870) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Created schema index Bridge.name {{(pid=76870) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [POLLOUT] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35991ffa-7684-5d5c-aaee-06d77b3a1be2', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.neutron [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:43 user nova-compute[76870]: INFO oslo.privsep.daemon [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpl9tcnpb6/privsep.sock']
Oct 20 14:30:43 user sudo[86214]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpl9tcnpb6/privsep.sock
Oct 20 14:30:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Releasing lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance network_info: |[{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:30:43 user sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Start _get_guest_xml network_info=[{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:30:43 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:43 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-421716088',display_name='tempest-ServerActionsTestOtherB-server-421716088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-421716088',id=1,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5J1bkU05EsA9oLI2fFKX8jeghB7OrfieDYZJWE7wot0V9HQuQJYNbZk0BZfAsp4fuH8lc38ZICaToK7lrfRSosV9s8NqH/c8C3FaEjKVHZC1H80U+qw7HizpqyaPVw2g==',key_name='tempest-keypair-1128736685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ff7a7bc4204024a9e126a78a8c45bb',ramdisk_id='',reservation_id='r-8yrn360w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1628594369',owner_user_name='tempest-ServerActionsTestOtherB-1628594369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37fcf98d035d4ed8a6de3a15e78d3318',uuid=a734d0c6-9dff-4254-9231-040de2c5eacc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converting VIF {"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.objects.instance [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lazy-loading 'pci_devices' on Instance uuid a734d0c6-9dff-4254-9231-040de2c5eacc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:30:43 user nova-compute[76870]:   <uuid>a734d0c6-9dff-4254-9231-040de2c5eacc</uuid>
Oct 20 14:30:43 user nova-compute[76870]:   <name>instance-00000001</name>
Oct 20 14:30:43 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:30:43 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:30:43 user nova-compute[76870]:   <metadata>
Oct 20 14:30:43 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:30:43 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:name>tempest-ServerActionsTestOtherB-server-421716088</nova:name>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:30:43</nova:creationTime>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:30:43 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:30:43 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:owner>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:user uuid="37fcf98d035d4ed8a6de3a15e78d3318">tempest-ServerActionsTestOtherB-1628594369-project-member</nova:user>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:project uuid="29ff7a7bc4204024a9e126a78a8c45bb">tempest-ServerActionsTestOtherB-1628594369</nova:project>
Oct 20 14:30:43 user nova-compute[76870]:       </nova:owner>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:30:43 user nova-compute[76870]:       <nova:ports>
Oct 20 14:30:43 user nova-compute[76870]:         <nova:port uuid="a15cefc7-71b8-4c86-bf3d-ab69e98d6914">
Oct 20 14:30:43 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:30:43 user nova-compute[76870]:         </nova:port>
Oct 20 14:30:43 user nova-compute[76870]:       </nova:ports>
Oct 20 14:30:43 user nova-compute[76870]:     </nova:instance>
Oct 20 14:30:43 user nova-compute[76870]:   </metadata>
Oct 20 14:30:43 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:30:43 user nova-compute[76870]:     <system>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="serial">a734d0c6-9dff-4254-9231-040de2c5eacc</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="uuid">a734d0c6-9dff-4254-9231-040de2c5eacc</entry>
Oct 20 14:30:43 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:30:43 user nova-compute[76870]:     </system>
Oct 20 14:30:43 user nova-compute[76870]:   </sysinfo>
Oct 20 14:30:43 user nova-compute[76870]:   <os>
Oct 20 14:30:43 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:30:43 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:30:43 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:30:43 user nova-compute[76870]:   </os>
Oct 20 14:30:43 user nova-compute[76870]:   <features>
Oct 20 14:30:43 user nova-compute[76870]:     <acpi/>
Oct 20 14:30:43 user nova-compute[76870]:     <apic/>
Oct 20 14:30:43 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:30:43 user nova-compute[76870]:   </features>
Oct 20 14:30:43 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:30:43 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:30:43 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:30:43 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:30:43 user nova-compute[76870]:   </clock>
Oct 20 14:30:43 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:30:43 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:30:43 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:30:43 user nova-compute[76870]:   </cpu>
Oct 20 14:30:43 user nova-compute[76870]:   <devices>
Oct 20 14:30:43 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:30:43 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:30:43 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk"/>
Oct 20 14:30:43 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:30:43 user nova-compute[76870]:     </disk>
Oct 20 14:30:43 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:30:43 user nova-compute[76870]:       <mac address="fa:16:3e:c8:d2:ab"/>
Oct 20 14:30:43 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:43 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:30:43 user nova-compute[76870]:       <target dev="tapa15cefc7-71"/>
Oct 20 14:30:43 user nova-compute[76870]:     </interface>
Oct 20 14:30:43 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:30:43 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/console.log" append="off"/>
Oct 20 14:30:43 user nova-compute[76870]:     </serial>
Oct 20 14:30:43 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:30:43 user nova-compute[76870]:     <video>
Oct 20 14:30:43 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:43 user nova-compute[76870]:     </video>
Oct 20 14:30:43 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:30:43 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:30:43 user nova-compute[76870]:     </rng>
Oct 20 14:30:43 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:30:43 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:30:43 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:30:43 user nova-compute[76870]:     </memballoon>
Oct 20 14:30:43 user nova-compute[76870]:   </devices>
Oct 20 14:30:43 user nova-compute[76870]: </domain>
Oct 20 14:30:43 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-421716088',display_name='tempest-ServerActionsTestOtherB-server-421716088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-421716088',id=1,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5J1bkU05EsA9oLI2fFKX8jeghB7OrfieDYZJWE7wot0V9HQuQJYNbZk0BZfAsp4fuH8lc38ZICaToK7lrfRSosV9s8NqH/c8C3FaEjKVHZC1H80U+qw7HizpqyaPVw2g==',key_name='tempest-keypair-1128736685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ff7a7bc4204024a9e126a78a8c45bb',ramdisk_id='',reservation_id='r-8yrn360w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1628594369',owner_user_name='tempest-ServerActionsTestOtherB-1628594369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37fcf98d035d4ed8a6de3a15e78d3318',uuid=a734d0c6-9dff-4254-9231-040de2c5eacc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converting VIF {"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG os_vif [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91b8db44-73a2-5fff-94ad-15a3490c3f07', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG nova.network.neutron [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updated VIF entry in instance network info cache for port acd2d180-ce3c-4f57-83c1-704e124462a9. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG nova.network.neutron [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updating instance_info_cache with network_info: [{"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2efd1b6d-e3ff-4924-81e1-60372fa3e7fe req-4a4ffe8d-fbb3-42ae-af21-1d6c7562a3ed service nova] Releasing lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-changed-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Refreshing instance network info cache due to event network-changed-a15cefc7-71b8-4c86-bf3d-ab69e98d6914. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] Acquiring lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] Acquired lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:44 user nova-compute[76870]: DEBUG nova.network.neutron [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Refreshing network info cache for port a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Successfully updated port: fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:30:45 user sudo[86214]: pam_unix(sudo:session): session closed for user root
Oct 20 14:30:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:30:45 user nova-compute[76870]: INFO oslo.privsep.daemon [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Spawned new privsep daemon via rootwrap
Oct 20 14:30:45 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 14:30:45 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 14:30:45 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 14:30:45 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86219
Oct 20 14:30:45 user nova-compute[76870]: WARNING oslo_privsep.priv_context [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] privsep daemon already running
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updated VIF entry in instance network info cache for port a15cefc7-71b8-4c86-bf3d-ab69e98d6914. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-90ff5476-84c4-4d9f-8eda-e767d165d5d7 req-bdaf9971-f639-4123-9018-0bfcea9f3306 service nova] Releasing lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-changed-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Refreshing instance network info cache due to event network-changed-fa79a316-749b-41e5-811d-c28cdd5ae51e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:30:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacd2d180-ce, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacd2d180-ce, col_values=(('qos', UUID('9e463eeb-1e34-41f5-854f-c48899c061a6')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacd2d180-ce, col_values=(('external_ids', {'iface-id': 'acd2d180-ce3c-4f57-83c1-704e124462a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:0a:33', 'vm-uuid': 'd44194ba-73e7-47f2-b2a8-fa157641a48c'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa15cefc7-71, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa15cefc7-71, col_values=(('qos', UUID('bfb961f7-ea92-479a-b58b-5ae635d12043')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa15cefc7-71, col_values=(('external_ids', {'iface-id': 'a15cefc7-71b8-4c86-bf3d-ab69e98d6914', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:d2:ab', 'vm-uuid': 'a734d0c6-9dff-4254-9231-040de2c5eacc'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: INFO os_vif [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce')
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: INFO os_vif [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71')
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] No VIF found with MAC fa:16:3e:f2:0a:33, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] No VIF found with MAC fa:16:3e:c8:d2:ab, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Instance network_info: |[{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Refreshing network info cache for port fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Start _get_guest_xml network_info=[{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:30:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2130770255',display_name='tempest-ServerActionsTestOtherA-server-2130770255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2130770255',id=3,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-z9s7geqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c478f46b-f60b-4000-bc45-92430bd9b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.objects.instance [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'pci_devices' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:30:46 user nova-compute[76870]:   <uuid>c478f46b-f60b-4000-bc45-92430bd9b3af</uuid>
Oct 20 14:30:46 user nova-compute[76870]:   <name>instance-00000003</name>
Oct 20 14:30:46 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:30:46 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:30:46 user nova-compute[76870]:   <metadata>
Oct 20 14:30:46 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:30:46 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:30:46 user nova-compute[76870]:       <nova:name>tempest-ServerActionsTestOtherA-server-2130770255</nova:name>
Oct 20 14:30:46 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:30:46</nova:creationTime>
Oct 20 14:30:46 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:30:46 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:30:46 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:30:46 user nova-compute[76870]:       <nova:owner>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:user uuid="91e65eb07d084dcb9e5e9188961f4b44">tempest-ServerActionsTestOtherA-404958601-project-member</nova:user>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:project uuid="94c8ea9d998b4ba587b16fec8b792c13">tempest-ServerActionsTestOtherA-404958601</nova:project>
Oct 20 14:30:46 user nova-compute[76870]:       </nova:owner>
Oct 20 14:30:46 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:30:46 user nova-compute[76870]:       <nova:ports>
Oct 20 14:30:46 user nova-compute[76870]:         <nova:port uuid="fa79a316-749b-41e5-811d-c28cdd5ae51e">
Oct 20 14:30:46 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 14:30:46 user nova-compute[76870]:         </nova:port>
Oct 20 14:30:46 user nova-compute[76870]:       </nova:ports>
Oct 20 14:30:46 user nova-compute[76870]:     </nova:instance>
Oct 20 14:30:46 user nova-compute[76870]:   </metadata>
Oct 20 14:30:46 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:30:46 user nova-compute[76870]:     <system>
Oct 20 14:30:46 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:30:46 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:30:46 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:30:46 user nova-compute[76870]:       <entry name="serial">c478f46b-f60b-4000-bc45-92430bd9b3af</entry>
Oct 20 14:30:46 user nova-compute[76870]:       <entry name="uuid">c478f46b-f60b-4000-bc45-92430bd9b3af</entry>
Oct 20 14:30:46 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:30:46 user nova-compute[76870]:     </system>
Oct 20 14:30:46 user nova-compute[76870]:   </sysinfo>
Oct 20 14:30:46 user nova-compute[76870]:   <os>
Oct 20 14:30:46 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:30:46 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:30:46 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:30:46 user nova-compute[76870]:   </os>
Oct 20 14:30:46 user nova-compute[76870]:   <features>
Oct 20 14:30:46 user nova-compute[76870]:     <acpi/>
Oct 20 14:30:46 user nova-compute[76870]:     <apic/>
Oct 20 14:30:46 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:30:46 user nova-compute[76870]:   </features>
Oct 20 14:30:46 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:30:46 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:30:46 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:30:46 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:30:46 user nova-compute[76870]:   </clock>
Oct 20 14:30:46 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:30:46 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:30:46 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:30:46 user nova-compute[76870]:   </cpu>
Oct 20 14:30:46 user nova-compute[76870]:   <devices>
Oct 20 14:30:46 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:30:46 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:30:46 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk"/>
Oct 20 14:30:46 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:30:46 user nova-compute[76870]:     </disk>
Oct 20 14:30:46 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:30:46 user nova-compute[76870]:       <mac address="fa:16:3e:94:a7:98"/>
Oct 20 14:30:46 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:46 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:30:46 user nova-compute[76870]:       <target dev="tapfa79a316-74"/>
Oct 20 14:30:46 user nova-compute[76870]:     </interface>
Oct 20 14:30:46 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:30:46 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/console.log" append="off"/>
Oct 20 14:30:46 user nova-compute[76870]:     </serial>
Oct 20 14:30:46 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:30:46 user nova-compute[76870]:     <video>
Oct 20 14:30:46 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:46 user nova-compute[76870]:     </video>
Oct 20 14:30:46 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:30:46 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:30:46 user nova-compute[76870]:     </rng>
Oct 20 14:30:46 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:30:46 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:30:46 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:30:46 user nova-compute[76870]:     </memballoon>
Oct 20 14:30:46 user nova-compute[76870]:   </devices>
Oct 20 14:30:46 user nova-compute[76870]: </domain>
Oct 20 14:30:46 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2130770255',display_name='tempest-ServerActionsTestOtherA-server-2130770255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2130770255',id=3,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-z9s7geqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c478f46b-f60b-4000-bc45-92430bd9b3af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG os_vif [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fe237f8-1d06-5992-ad3e-4728ec2de07e', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa79a316-74, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa79a316-74, col_values=(('qos', UUID('ccbb5e52-ab7a-4b73-85e8-0de44e87fd51')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa79a316-74, col_values=(('external_ids', {'iface-id': 'fa79a316-749b-41e5-811d-c28cdd5ae51e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:a7:98', 'vm-uuid': 'c478f46b-f60b-4000-bc45-92430bd9b3af'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:46 user nova-compute[76870]: INFO os_vif [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74')
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:30:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No VIF found with MAC fa:16:3e:94:a7:98, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:30:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated VIF entry in instance network info cache for port fa79a316-749b-41e5-811d-c28cdd5ae51e. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:30:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7c871246-a82e-4ee2-9d65-da12b3aec6e7 req-cc507fec-3e31-4649-ad10-62689c0f4338 service nova] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:30:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Instance spawned successfully.
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:52 user nova-compute[76870]: INFO nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Took 16.94 seconds to spawn the instance on the hypervisor.
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:30:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Instance spawned successfully.
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:30:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance spawned successfully.
Oct 20 14:30:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:30:53 user nova-compute[76870]: INFO nova.compute.manager [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Took 18.26 seconds to build instance.
Oct 20 14:30:53 user nova-compute[76870]: INFO nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Took 18.56 seconds to spawn the instance on the hypervisor.
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-522269a3-3b53-485d-8202-59135a28d791 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.435s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:53 user nova-compute[76870]: INFO nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Took 11.90 seconds to spawn the instance on the hypervisor.
Oct 20 14:30:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:30:53 user nova-compute[76870]: INFO nova.compute.manager [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Took 19.73 seconds to build instance.
Oct 20 14:30:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e8aa11-2820-45f3-a4a0-eeb8ef6ef826 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.953s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:53 user nova-compute[76870]: INFO nova.compute.manager [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Took 12.63 seconds to build instance.
Oct 20 14:30:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-db88b260-267b-48ba-9ec2-4f7293d7687e tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.809s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:30:54 user nova-compute[76870]: INFO nova.compute.claims [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Claim successful on node user
Oct 20 14:30:54 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG nova.network.neutron [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:30:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:30:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG nova.policy [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f25d5591b5774753b836d3a0e6397166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f772f1ee2134d1b99bec5ac66ffe495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:30:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Creating image(s)
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "/opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "/opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "/opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.329s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.322s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk 1073741824" returned: 0 in 0.110s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Successfully created port: 9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.305s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Cannot resize image /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Ensure instance console log exists: /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Successfully updated port: 9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquired lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-changed-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Refreshing instance network info cache due to event network-changed-9efda0d6-1c7b-4233-9206-e83e5661af3e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] Acquiring lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:30:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:30:58 user nova-compute[76870]: INFO nova.compute.claims [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Claim successful on node user
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating instance_info_cache with network_info: [{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Releasing lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Instance network_info: |[{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] Acquired lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.neutron [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Refreshing network info cache for port 9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Start _get_guest_xml network_info=[{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:30:59 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:59 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1057852179',display_name='tempest-VolumesAdminNegativeTest-server-1057852179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1057852179',id=4,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADpL9PSaEDrERcE6nbtyvq5Jo560y37YtX/0b+lGOaCvUf7rvf63Zg3QFJF019nqXCkg9glrv+RdamhTllsdo6Z3jF8dRWobA06sFND/EhE4ZShcMzEua+s1PIKHwFxqQ==',key_name='tempest-keypair-1576509653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f772f1ee2134d1b99bec5ac66ffe495',ramdisk_id='',reservation_id='r-58srqupd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1322350658',owner_user_name='tempest-VolumesAdminNegativeTest-1322350658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f25d5591b5774753b836d3a0e6397166',uuid=d03d6cc9-1e71-49a9-aaae-f1ec46254200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converting VIF {"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.objects.instance [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lazy-loading 'pci_devices' on Instance uuid d03d6cc9-1e71-49a9-aaae-f1ec46254200 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:30:59 user nova-compute[76870]:   <uuid>d03d6cc9-1e71-49a9-aaae-f1ec46254200</uuid>
Oct 20 14:30:59 user nova-compute[76870]:   <name>instance-00000004</name>
Oct 20 14:30:59 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:30:59 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:30:59 user nova-compute[76870]:   <metadata>
Oct 20 14:30:59 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:30:59 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:30:59 user nova-compute[76870]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1057852179</nova:name>
Oct 20 14:30:59 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:30:59</nova:creationTime>
Oct 20 14:30:59 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:30:59 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:30:59 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:30:59 user nova-compute[76870]:       <nova:owner>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:user uuid="f25d5591b5774753b836d3a0e6397166">tempest-VolumesAdminNegativeTest-1322350658-project-member</nova:user>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:project uuid="9f772f1ee2134d1b99bec5ac66ffe495">tempest-VolumesAdminNegativeTest-1322350658</nova:project>
Oct 20 14:30:59 user nova-compute[76870]:       </nova:owner>
Oct 20 14:30:59 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:30:59 user nova-compute[76870]:       <nova:ports>
Oct 20 14:30:59 user nova-compute[76870]:         <nova:port uuid="9efda0d6-1c7b-4233-9206-e83e5661af3e">
Oct 20 14:30:59 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 14:30:59 user nova-compute[76870]:         </nova:port>
Oct 20 14:30:59 user nova-compute[76870]:       </nova:ports>
Oct 20 14:30:59 user nova-compute[76870]:     </nova:instance>
Oct 20 14:30:59 user nova-compute[76870]:   </metadata>
Oct 20 14:30:59 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:30:59 user nova-compute[76870]:     <system>
Oct 20 14:30:59 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:30:59 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:30:59 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:30:59 user nova-compute[76870]:       <entry name="serial">d03d6cc9-1e71-49a9-aaae-f1ec46254200</entry>
Oct 20 14:30:59 user nova-compute[76870]:       <entry name="uuid">d03d6cc9-1e71-49a9-aaae-f1ec46254200</entry>
Oct 20 14:30:59 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:30:59 user nova-compute[76870]:     </system>
Oct 20 14:30:59 user nova-compute[76870]:   </sysinfo>
Oct 20 14:30:59 user nova-compute[76870]:   <os>
Oct 20 14:30:59 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:30:59 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:30:59 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:30:59 user nova-compute[76870]:   </os>
Oct 20 14:30:59 user nova-compute[76870]:   <features>
Oct 20 14:30:59 user nova-compute[76870]:     <acpi/>
Oct 20 14:30:59 user nova-compute[76870]:     <apic/>
Oct 20 14:30:59 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:30:59 user nova-compute[76870]:   </features>
Oct 20 14:30:59 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:30:59 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:30:59 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:30:59 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:30:59 user nova-compute[76870]:   </clock>
Oct 20 14:30:59 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:30:59 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:30:59 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:30:59 user nova-compute[76870]:   </cpu>
Oct 20 14:30:59 user nova-compute[76870]:   <devices>
Oct 20 14:30:59 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:30:59 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:30:59 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk"/>
Oct 20 14:30:59 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:30:59 user nova-compute[76870]:     </disk>
Oct 20 14:30:59 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:30:59 user nova-compute[76870]:       <mac address="fa:16:3e:df:75:50"/>
Oct 20 14:30:59 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:59 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:30:59 user nova-compute[76870]:       <target dev="tap9efda0d6-1c"/>
Oct 20 14:30:59 user nova-compute[76870]:     </interface>
Oct 20 14:30:59 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:30:59 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/console.log" append="off"/>
Oct 20 14:30:59 user nova-compute[76870]:     </serial>
Oct 20 14:30:59 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:30:59 user nova-compute[76870]:     <video>
Oct 20 14:30:59 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:30:59 user nova-compute[76870]:     </video>
Oct 20 14:30:59 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:30:59 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:30:59 user nova-compute[76870]:     </rng>
Oct 20 14:30:59 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:30:59 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:30:59 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:30:59 user nova-compute[76870]:     </memballoon>
Oct 20 14:30:59 user nova-compute[76870]:   </devices>
Oct 20 14:30:59 user nova-compute[76870]: </domain>
Oct 20 14:30:59 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1057852179',display_name='tempest-VolumesAdminNegativeTest-server-1057852179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1057852179',id=4,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADpL9PSaEDrERcE6nbtyvq5Jo560y37YtX/0b+lGOaCvUf7rvf63Zg3QFJF019nqXCkg9glrv+RdamhTllsdo6Z3jF8dRWobA06sFND/EhE4ZShcMzEua+s1PIKHwFxqQ==',key_name='tempest-keypair-1576509653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f772f1ee2134d1b99bec5ac66ffe495',ramdisk_id='',reservation_id='r-58srqupd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1322350658',owner_user_name='tempest-VolumesAdminNegativeTest-1322350658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f25d5591b5774753b836d3a0e6397166',uuid=d03d6cc9-1e71-49a9-aaae-f1ec46254200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converting VIF {"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG os_vif [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b1171e1-fb3f-5c4d-84dd-740303388fea', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9efda0d6-1c, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9efda0d6-1c, col_values=(('qos', UUID('d55256b3-8f36-4bee-bfe5-3da55eb6419a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9efda0d6-1c, col_values=(('external_ids', {'iface-id': '9efda0d6-1c7b-4233-9206-e83e5661af3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:75:50', 'vm-uuid': 'd03d6cc9-1e71-49a9-aaae-f1ec46254200'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: INFO os_vif [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c')
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] No VIF found with MAC fa:16:3e:df:75:50, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.751s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:30:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.policy [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f98270a4554d29845e8dea8221cb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef293efe943499dad6ec1dafa8ac9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.neutron [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updated VIF entry in instance network info cache for port 9efda0d6-1c7b-4233-9206-e83e5661af3e. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG nova.network.neutron [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating instance_info_cache with network_info: [{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:30:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9debc68b-aee8-47ba-8988-a29bd545b2c9 req-adfda06b-42a7-41a2-a0ac-b8c89e3c286d service nova] Releasing lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:31:00 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Creating image(s)
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "/opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "/opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cb9b623f9ce0fbb35b074f31933196eb725c8457" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cb9b623f9ce0fbb35b074f31933196eb725c8457" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.part --force-share --output=json" returned: 0 in 0.281s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG nova.virt.images [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] 377cdc91-9ffc-4382-a473-635447ba359a was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:31:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.part /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Successfully created port: 95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.part /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.converted" returned: 0 in 0.464s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457.converted --force-share --output=json" returned: 0 in 0.262s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cb9b623f9ce0fbb35b074f31933196eb725c8457" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457 --force-share --output=json" returned: 0 in 0.248s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cb9b623f9ce0fbb35b074f31933196eb725c8457" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cb9b623f9ce0fbb35b074f31933196eb725c8457" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457 --force-share --output=json" returned: 0 in 0.244s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457,backing_fmt=raw /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457,backing_fmt=raw /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk 1073741824" returned: 0 in 0.076s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cb9b623f9ce0fbb35b074f31933196eb725c8457" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Successfully updated port: 95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquired lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-changed-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Refreshing instance network info cache due to event network-changed-95871811-8a03-4445-9469-aa9fe96bcdd9. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] Acquiring lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457 --force-share --output=json" returned: 0 in 0.220s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Cannot resize image /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Ensure instance console log exists: /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updating instance_info_cache with network_info: [{"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Releasing lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Instance network_info: |[{"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] Acquired lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Refreshing network info cache for port 95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:31:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Start _get_guest_xml network_info=[{"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:30:50Z,direct_url=<?>,disk_format='qcow2',id=377cdc91-9ffc-4382-a473-635447ba359a,min_disk=0,min_ram=0,name='',owner='db1a3609914f42778cf0844cef74f4ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:30:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '377cdc91-9ffc-4382-a473-635447ba359a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:31:03 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:03 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:30:50Z,direct_url=<?>,disk_format='qcow2',id=377cdc91-9ffc-4382-a473-635447ba359a,min_disk=0,min_ram=0,name='',owner='db1a3609914f42778cf0844cef74f4ac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:30:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1680072135',display_name='tempest-AttachSCSIVolumeTestJSON-server-1680072135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1680072135',id=5,image_ref='377cdc91-9ffc-4382-a473-635447ba359a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyOc9SsFuZu1uYLxG/Eemg0AlMBs1Ah6WZQdNMymSouCLA2m5PSpVSybF8OfDZBvKAxBohSHKfblRD5RW75R/OT7rx6yN/wnI7jkEMvDvrLpbM95ZgZ4CdjjUSP88TQLQ==',key_name='tempest-keypair-1192210980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ef293efe943499dad6ec1dafa8ac9a4',ramdisk_id='',reservation_id='r-e0dmdrra',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='377cdc91-9ffc-4382-a473-635447ba359a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-550858638',owner_user_name='tempest-AttachSCSIVolumeTestJSON-550858638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f98270a4554d29845e8dea8221cb05',uuid=cc506fab-01ee-4944-b09f-f97fd0c21c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Converting VIF {"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.objects.instance [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lazy-loading 'pci_devices' on Instance uuid cc506fab-01ee-4944-b09f-f97fd0c21c77 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:31:03 user nova-compute[76870]: INFO nova.compute.claims [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Claim successful on node user
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:31:03 user nova-compute[76870]:   <uuid>cc506fab-01ee-4944-b09f-f97fd0c21c77</uuid>
Oct 20 14:31:03 user nova-compute[76870]:   <name>instance-00000005</name>
Oct 20 14:31:03 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:31:03 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:31:03 user nova-compute[76870]:   <metadata>
Oct 20 14:31:03 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:31:03 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:31:03 user nova-compute[76870]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1680072135</nova:name>
Oct 20 14:31:03 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:31:03</nova:creationTime>
Oct 20 14:31:03 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:31:03 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:31:03 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:31:03 user nova-compute[76870]:       <nova:owner>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:user uuid="33f98270a4554d29845e8dea8221cb05">tempest-AttachSCSIVolumeTestJSON-550858638-project-member</nova:user>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:project uuid="5ef293efe943499dad6ec1dafa8ac9a4">tempest-AttachSCSIVolumeTestJSON-550858638</nova:project>
Oct 20 14:31:03 user nova-compute[76870]:       </nova:owner>
Oct 20 14:31:03 user nova-compute[76870]:       <nova:root type="image" uuid="377cdc91-9ffc-4382-a473-635447ba359a"/>
Oct 20 14:31:03 user nova-compute[76870]:       <nova:ports>
Oct 20 14:31:03 user nova-compute[76870]:         <nova:port uuid="95871811-8a03-4445-9469-aa9fe96bcdd9">
Oct 20 14:31:03 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 14:31:03 user nova-compute[76870]:         </nova:port>
Oct 20 14:31:03 user nova-compute[76870]:       </nova:ports>
Oct 20 14:31:03 user nova-compute[76870]:     </nova:instance>
Oct 20 14:31:03 user nova-compute[76870]:   </metadata>
Oct 20 14:31:03 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:31:03 user nova-compute[76870]:     <system>
Oct 20 14:31:03 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:31:03 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:31:03 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:31:03 user nova-compute[76870]:       <entry name="serial">cc506fab-01ee-4944-b09f-f97fd0c21c77</entry>
Oct 20 14:31:03 user nova-compute[76870]:       <entry name="uuid">cc506fab-01ee-4944-b09f-f97fd0c21c77</entry>
Oct 20 14:31:03 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:31:03 user nova-compute[76870]:     </system>
Oct 20 14:31:03 user nova-compute[76870]:   </sysinfo>
Oct 20 14:31:03 user nova-compute[76870]:   <os>
Oct 20 14:31:03 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:31:03 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:31:03 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:31:03 user nova-compute[76870]:   </os>
Oct 20 14:31:03 user nova-compute[76870]:   <features>
Oct 20 14:31:03 user nova-compute[76870]:     <acpi/>
Oct 20 14:31:03 user nova-compute[76870]:     <apic/>
Oct 20 14:31:03 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:31:03 user nova-compute[76870]:   </features>
Oct 20 14:31:03 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:31:03 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:31:03 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:31:03 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:31:03 user nova-compute[76870]:   </clock>
Oct 20 14:31:03 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:31:03 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:31:03 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:31:03 user nova-compute[76870]:   </cpu>
Oct 20 14:31:03 user nova-compute[76870]:   <devices>
Oct 20 14:31:03 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:31:03 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:31:03 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk"/>
Oct 20 14:31:03 user nova-compute[76870]:       <target dev="sda" bus="scsi"/>
Oct 20 14:31:03 user nova-compute[76870]:       <address type="drive" controller="0" unit="0"/>
Oct 20 14:31:03 user nova-compute[76870]:     </disk>
Oct 20 14:31:03 user nova-compute[76870]:     <disk type="file" device="cdrom">
Oct 20 14:31:03 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 14:31:03 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.config"/>
Oct 20 14:31:03 user nova-compute[76870]:       <target dev="sdb" bus="scsi"/>
Oct 20 14:31:03 user nova-compute[76870]:       <address type="drive" controller="0" unit="1"/>
Oct 20 14:31:03 user nova-compute[76870]:     </disk>
Oct 20 14:31:03 user nova-compute[76870]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 14:31:03 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:31:03 user nova-compute[76870]:       <mac address="fa:16:3e:f8:ff:9a"/>
Oct 20 14:31:03 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:31:03 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:31:03 user nova-compute[76870]:       <target dev="tap95871811-8a"/>
Oct 20 14:31:03 user nova-compute[76870]:     </interface>
Oct 20 14:31:03 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:31:03 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/console.log" append="off"/>
Oct 20 14:31:03 user nova-compute[76870]:     </serial>
Oct 20 14:31:03 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:31:03 user nova-compute[76870]:     <video>
Oct 20 14:31:03 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:31:03 user nova-compute[76870]:     </video>
Oct 20 14:31:03 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:31:03 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:31:03 user nova-compute[76870]:     </rng>
Oct 20 14:31:03 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:31:03 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:31:03 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:31:03 user nova-compute[76870]:     </memballoon>
Oct 20 14:31:03 user nova-compute[76870]:   </devices>
Oct 20 14:31:03 user nova-compute[76870]: </domain>
Oct 20 14:31:03 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1680072135',display_name='tempest-AttachSCSIVolumeTestJSON-server-1680072135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1680072135',id=5,image_ref='377cdc91-9ffc-4382-a473-635447ba359a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyOc9SsFuZu1uYLxG/Eemg0AlMBs1Ah6WZQdNMymSouCLA2m5PSpVSybF8OfDZBvKAxBohSHKfblRD5RW75R/OT7rx6yN/wnI7jkEMvDvrLpbM95ZgZ4CdjjUSP88TQLQ==',key_name='tempest-keypair-1192210980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ef293efe943499dad6ec1dafa8ac9a4',ramdisk_id='',reservation_id='r-e0dmdrra',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='377cdc91-9ffc-4382-a473-635447ba359a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-550858638',owner_user_name='tempest-AttachSCSIVolumeTestJSON-550858638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f98270a4554d29845e8dea8221cb05',uuid=cc506fab-01ee-4944-b09f-f97fd0c21c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Converting VIF {"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG os_vif [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b794d25a-b349-5566-b19a-e781e0ad2c7f', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95871811-8a, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95871811-8a, col_values=(('qos', UUID('4892b554-335a-4da1-84b9-30800989ad3e')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95871811-8a, col_values=(('external_ids', {'iface-id': '95871811-8a03-4445-9469-aa9fe96bcdd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:ff:9a', 'vm-uuid': 'cc506fab-01ee-4944-b09f-f97fd0c21c77'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:03 user nova-compute[76870]: INFO os_vif [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a')
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No BDM found with device name sda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No VIF found with MAC fa:16:3e:f8:ff:9a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:31:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Using config drive
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updated VIF entry in instance network info cache for port 95871811-8a03-4445-9469-aa9fe96bcdd9. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updating instance_info_cache with network_info: [{"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a17e2e8e-ada5-4b47-845f-67d94c7ef6bb req-5d711e46-1e20-4244-a5de-6dd26e17050b service nova] Releasing lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:31:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:31:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Creating config drive at /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.config
Oct 20 14:31:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz_ci1u5q {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG nova.policy [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db0c5c37a67348e685ea17e285950d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d384a2bb004716871df6ec84d5b42c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:31:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz_ci1u5q" returned: 0 in 0.072s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:31:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Creating image(s)
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "/opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "/opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.255s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Instance spawned successfully.
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:04 user nova-compute[76870]: INFO nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Took 9.19 seconds to spawn the instance on the hypervisor.
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.242s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk 1073741824" returned: 0 in 0.086s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:04 user nova-compute[76870]: INFO nova.compute.manager [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Took 10.47 seconds to build instance.
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-64afa637-fbc1-45be-9fdb-d6f599762ec9 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.698s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.229s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:31:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Cannot resize image /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Ensure instance console log exists: /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Successfully created port: f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a4df27aa-5cbc-469e-9bec-a9edbbd172b3 req-c7b1ec1d-d194-47d1-9e8b-46158c46697e service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a4df27aa-5cbc-469e-9bec-a9edbbd172b3 req-c7b1ec1d-d194-47d1-9e8b-46158c46697e service nova] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a4df27aa-5cbc-469e-9bec-a9edbbd172b3 req-c7b1ec1d-d194-47d1-9e8b-46158c46697e service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a4df27aa-5cbc-469e-9bec-a9edbbd172b3 req-c7b1ec1d-d194-47d1-9e8b-46158c46697e service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a4df27aa-5cbc-469e-9bec-a9edbbd172b3 req-c7b1ec1d-d194-47d1-9e8b-46158c46697e service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] No waiting events found dispatching network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:05 user nova-compute[76870]: WARNING nova.compute.manager [req-a4df27aa-5cbc-469e-9bec-a9edbbd172b3 req-c7b1ec1d-d194-47d1-9e8b-46158c46697e service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received unexpected event network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 for instance with vm_state building and task_state spawning.
Oct 20 14:31:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Successfully updated port: f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquired lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-changed-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Refreshing instance network info cache due to event network-changed-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] Acquiring lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:31:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updating instance_info_cache with network_info: [{"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Releasing lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Instance network_info: |[{"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] Acquired lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Refreshing network info cache for port f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Start _get_guest_xml network_info=[{"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:31:07 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:07 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1907430451',display_name='tempest-TestVolumeSwap-server-1907430451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1907430451',id=6,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsDP/L6Ur4MDQdJ8knCLX6wMFUwXdQkkWIJrougBAXv4LF7yOyT6OiSBp312OLQJ2MGd87HlUnbHKWaaelZUNnnR9IsnLshpOlxRM6ToOFiidCdvqOOGn+qfm4Ofn4BhQ==',key_name='tempest-keypair-1354219287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d384a2bb004716871df6ec84d5b42c',ramdisk_id='',reservation_id='r-cmp97say',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1936833443',owner_user_name='tempest-TestVolumeSwap-1936833443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0c5c37a67348e685ea17e285950d28',uuid=b8caf8f2-6533-4a01-b2fe-ce1899dff98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Converting VIF {"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lazy-loading 'pci_devices' on Instance uuid b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:31:07 user nova-compute[76870]:   <uuid>b8caf8f2-6533-4a01-b2fe-ce1899dff98d</uuid>
Oct 20 14:31:07 user nova-compute[76870]:   <name>instance-00000006</name>
Oct 20 14:31:07 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:31:07 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:31:07 user nova-compute[76870]:   <metadata>
Oct 20 14:31:07 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:31:07 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:31:07 user nova-compute[76870]:       <nova:name>tempest-TestVolumeSwap-server-1907430451</nova:name>
Oct 20 14:31:07 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:31:07</nova:creationTime>
Oct 20 14:31:07 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:31:07 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:31:07 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:31:07 user nova-compute[76870]:       <nova:owner>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:user uuid="db0c5c37a67348e685ea17e285950d28">tempest-TestVolumeSwap-1936833443-project-member</nova:user>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:project uuid="64d384a2bb004716871df6ec84d5b42c">tempest-TestVolumeSwap-1936833443</nova:project>
Oct 20 14:31:07 user nova-compute[76870]:       </nova:owner>
Oct 20 14:31:07 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:31:07 user nova-compute[76870]:       <nova:ports>
Oct 20 14:31:07 user nova-compute[76870]:         <nova:port uuid="f48d0946-3b64-46f8-93ae-5e7fafa9f0f4">
Oct 20 14:31:07 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:31:07 user nova-compute[76870]:         </nova:port>
Oct 20 14:31:07 user nova-compute[76870]:       </nova:ports>
Oct 20 14:31:07 user nova-compute[76870]:     </nova:instance>
Oct 20 14:31:07 user nova-compute[76870]:   </metadata>
Oct 20 14:31:07 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:31:07 user nova-compute[76870]:     <system>
Oct 20 14:31:07 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:31:07 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:31:07 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:31:07 user nova-compute[76870]:       <entry name="serial">b8caf8f2-6533-4a01-b2fe-ce1899dff98d</entry>
Oct 20 14:31:07 user nova-compute[76870]:       <entry name="uuid">b8caf8f2-6533-4a01-b2fe-ce1899dff98d</entry>
Oct 20 14:31:07 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:31:07 user nova-compute[76870]:     </system>
Oct 20 14:31:07 user nova-compute[76870]:   </sysinfo>
Oct 20 14:31:07 user nova-compute[76870]:   <os>
Oct 20 14:31:07 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:31:07 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:31:07 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:31:07 user nova-compute[76870]:   </os>
Oct 20 14:31:07 user nova-compute[76870]:   <features>
Oct 20 14:31:07 user nova-compute[76870]:     <acpi/>
Oct 20 14:31:07 user nova-compute[76870]:     <apic/>
Oct 20 14:31:07 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:31:07 user nova-compute[76870]:   </features>
Oct 20 14:31:07 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:31:07 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:31:07 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:31:07 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:31:07 user nova-compute[76870]:   </clock>
Oct 20 14:31:07 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:31:07 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:31:07 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:31:07 user nova-compute[76870]:   </cpu>
Oct 20 14:31:07 user nova-compute[76870]:   <devices>
Oct 20 14:31:07 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:31:07 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:31:07 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk"/>
Oct 20 14:31:07 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:31:07 user nova-compute[76870]:     </disk>
Oct 20 14:31:07 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:31:07 user nova-compute[76870]:       <mac address="fa:16:3e:22:d2:84"/>
Oct 20 14:31:07 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:31:07 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:31:07 user nova-compute[76870]:       <target dev="tapf48d0946-3b"/>
Oct 20 14:31:07 user nova-compute[76870]:     </interface>
Oct 20 14:31:07 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:31:07 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/console.log" append="off"/>
Oct 20 14:31:07 user nova-compute[76870]:     </serial>
Oct 20 14:31:07 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:31:07 user nova-compute[76870]:     <video>
Oct 20 14:31:07 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:31:07 user nova-compute[76870]:     </video>
Oct 20 14:31:07 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:31:07 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:31:07 user nova-compute[76870]:     </rng>
Oct 20 14:31:07 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:31:07 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:31:07 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:31:07 user nova-compute[76870]:     </memballoon>
Oct 20 14:31:07 user nova-compute[76870]:   </devices>
Oct 20 14:31:07 user nova-compute[76870]: </domain>
Oct 20 14:31:07 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1907430451',display_name='tempest-TestVolumeSwap-server-1907430451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1907430451',id=6,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsDP/L6Ur4MDQdJ8knCLX6wMFUwXdQkkWIJrougBAXv4LF7yOyT6OiSBp312OLQJ2MGd87HlUnbHKWaaelZUNnnR9IsnLshpOlxRM6ToOFiidCdvqOOGn+qfm4Ofn4BhQ==',key_name='tempest-keypair-1354219287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d384a2bb004716871df6ec84d5b42c',ramdisk_id='',reservation_id='r-cmp97say',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1936833443',owner_user_name='tempest-TestVolumeSwap-1936833443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0c5c37a67348e685ea17e285950d28',uuid=b8caf8f2-6533-4a01-b2fe-ce1899dff98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Converting VIF {"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG os_vif [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1da9f4a6-6c57-5172-b589-e5804c7745b7', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf48d0946-3b, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf48d0946-3b, col_values=(('qos', UUID('feb9b774-ca80-4d06-87ac-5c95ec8395f7')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf48d0946-3b, col_values=(('external_ids', {'iface-id': 'f48d0946-3b64-46f8-93ae-5e7fafa9f0f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d2:84', 'vm-uuid': 'b8caf8f2-6533-4a01-b2fe-ce1899dff98d'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:07 user nova-compute[76870]: INFO os_vif [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b')
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] No VIF found with MAC fa:16:3e:22:d2:84, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updated VIF entry in instance network info cache for port f48d0946-3b64-46f8-93ae-5e7fafa9f0f4. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updating instance_info_cache with network_info: [{"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1bb33ef2-3d1a-4ad4-8a79-2f7eb7e30a97 req-2a16e05c-3a09-4d29-8dd4-1b5798ff2609 service nova] Releasing lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-3bfac3f5-c9a3-4ab2-b1a5-db88ddda81da req-00727b40-d734-4bb1-9590-2f0f262a0eec service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3bfac3f5-c9a3-4ab2-b1a5-db88ddda81da req-00727b40-d734-4bb1-9590-2f0f262a0eec service nova] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3bfac3f5-c9a3-4ab2-b1a5-db88ddda81da req-00727b40-d734-4bb1-9590-2f0f262a0eec service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3bfac3f5-c9a3-4ab2-b1a5-db88ddda81da req-00727b40-d734-4bb1-9590-2f0f262a0eec service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-3bfac3f5-c9a3-4ab2-b1a5-db88ddda81da req-00727b40-d734-4bb1-9590-2f0f262a0eec service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] No waiting events found dispatching network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:07 user nova-compute[76870]: WARNING nova.compute.manager [req-3bfac3f5-c9a3-4ab2-b1a5-db88ddda81da req-00727b40-d734-4bb1-9590-2f0f262a0eec service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received unexpected event network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 for instance with vm_state building and task_state spawning.
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:31:08 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Instance spawned successfully.
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:08 user nova-compute[76870]: INFO nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Took 8.69 seconds to spawn the instance on the hypervisor.
Oct 20 14:31:08 user nova-compute[76870]: DEBUG nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:08 user nova-compute[76870]: INFO nova.compute.manager [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Took 10.19 seconds to build instance.
Oct 20 14:31:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73bdcdae-6212-4e63-aced-6ebae7c7a2a5 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.392s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "62254105-7623-4f3c-923b-f3cb7d304044" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:31:09 user nova-compute[76870]: INFO nova.compute.claims [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Claim successful on node user
Oct 20 14:31:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:31:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.policy [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5392ac9b049f428fbe6c571e447ed404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cea561bd634daaa32c8dfcae4dcd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:31:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Creating image(s)
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "/opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "/opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "/opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.242s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.239s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk 1073741824" returned: 0 in 0.084s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.241s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Successfully created port: 5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Cannot resize image /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Ensure instance console log exists: /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:31:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Instance spawned successfully.
Oct 20 14:31:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:12 user nova-compute[76870]: INFO nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Took 8.08 seconds to spawn the instance on the hypervisor.
Oct 20 14:31:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:12 user nova-compute[76870]: INFO nova.compute.manager [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Took 9.25 seconds to build instance.
Oct 20 14:31:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d68fadb-80b7-4f02-97ae-f72338a61344 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.421s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Successfully updated port: 5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquired lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-changed-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Refreshing instance network info cache due to event network-changed-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] Acquiring lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updating instance_info_cache with network_info: [{"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Releasing lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Instance network_info: |[{"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] Acquired lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Refreshing network info cache for port 5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Start _get_guest_xml network_info=[{"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:31:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1939218114',display_name='tempest-VolumesAssistedSnapshotsTest-server-1939218114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1939218114',id=7,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnGhGtTe3UC0KFgsNO0TPKMNe13aQgpugbhbaV9eq6uPpHnuGEbbZsyjKpTykw4QCKdKU/9o1KitTBkIMxL+TVgzgtDzEgVfsgNEq8r4jrwpMBS0C2EpxmV75pLkpSZHA==',key_name='tempest-keypair-1203971672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cea561bd634daaa32c8dfcae4dcd8d',ramdisk_id='',reservation_id='r-5dso1j1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397347504',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397347504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5392ac9b049f428fbe6c571e447ed404',uuid=62254105-7623-4f3c-923b-f3cb7d304044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Converting VIF {"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lazy-loading 'pci_devices' on Instance uuid 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:31:13 user nova-compute[76870]:   <uuid>62254105-7623-4f3c-923b-f3cb7d304044</uuid>
Oct 20 14:31:13 user nova-compute[76870]:   <name>instance-00000007</name>
Oct 20 14:31:13 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:31:13 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:31:13 user nova-compute[76870]:   <metadata>
Oct 20 14:31:13 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:31:13 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:31:13 user nova-compute[76870]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1939218114</nova:name>
Oct 20 14:31:13 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:31:13</nova:creationTime>
Oct 20 14:31:13 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:31:13 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:31:13 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:31:13 user nova-compute[76870]:       <nova:owner>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:user uuid="5392ac9b049f428fbe6c571e447ed404">tempest-VolumesAssistedSnapshotsTest-1397347504-project-member</nova:user>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:project uuid="15cea561bd634daaa32c8dfcae4dcd8d">tempest-VolumesAssistedSnapshotsTest-1397347504</nova:project>
Oct 20 14:31:13 user nova-compute[76870]:       </nova:owner>
Oct 20 14:31:13 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:31:13 user nova-compute[76870]:       <nova:ports>
Oct 20 14:31:13 user nova-compute[76870]:         <nova:port uuid="5f5043bf-8e48-4aa3-8b03-de18ff8ef62d">
Oct 20 14:31:13 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 14:31:13 user nova-compute[76870]:         </nova:port>
Oct 20 14:31:13 user nova-compute[76870]:       </nova:ports>
Oct 20 14:31:13 user nova-compute[76870]:     </nova:instance>
Oct 20 14:31:13 user nova-compute[76870]:   </metadata>
Oct 20 14:31:13 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:31:13 user nova-compute[76870]:     <system>
Oct 20 14:31:13 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:31:13 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:31:13 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:31:13 user nova-compute[76870]:       <entry name="serial">62254105-7623-4f3c-923b-f3cb7d304044</entry>
Oct 20 14:31:13 user nova-compute[76870]:       <entry name="uuid">62254105-7623-4f3c-923b-f3cb7d304044</entry>
Oct 20 14:31:13 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:31:13 user nova-compute[76870]:     </system>
Oct 20 14:31:13 user nova-compute[76870]:   </sysinfo>
Oct 20 14:31:13 user nova-compute[76870]:   <os>
Oct 20 14:31:13 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:31:13 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:31:13 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:31:13 user nova-compute[76870]:   </os>
Oct 20 14:31:13 user nova-compute[76870]:   <features>
Oct 20 14:31:13 user nova-compute[76870]:     <acpi/>
Oct 20 14:31:13 user nova-compute[76870]:     <apic/>
Oct 20 14:31:13 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:31:13 user nova-compute[76870]:   </features>
Oct 20 14:31:13 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:31:13 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:31:13 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:31:13 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:31:13 user nova-compute[76870]:   </clock>
Oct 20 14:31:13 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:31:13 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:31:13 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:31:13 user nova-compute[76870]:   </cpu>
Oct 20 14:31:13 user nova-compute[76870]:   <devices>
Oct 20 14:31:13 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:31:13 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:31:13 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk"/>
Oct 20 14:31:13 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:31:13 user nova-compute[76870]:     </disk>
Oct 20 14:31:13 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:31:13 user nova-compute[76870]:       <mac address="fa:16:3e:f5:28:f9"/>
Oct 20 14:31:13 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:31:13 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:31:13 user nova-compute[76870]:       <target dev="tap5f5043bf-8e"/>
Oct 20 14:31:13 user nova-compute[76870]:     </interface>
Oct 20 14:31:13 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:31:13 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/console.log" append="off"/>
Oct 20 14:31:13 user nova-compute[76870]:     </serial>
Oct 20 14:31:13 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:31:13 user nova-compute[76870]:     <video>
Oct 20 14:31:13 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:31:13 user nova-compute[76870]:     </video>
Oct 20 14:31:13 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:31:13 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:31:13 user nova-compute[76870]:     </rng>
Oct 20 14:31:13 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:31:13 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:31:13 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:31:13 user nova-compute[76870]:     </memballoon>
Oct 20 14:31:13 user nova-compute[76870]:   </devices>
Oct 20 14:31:13 user nova-compute[76870]: </domain>
Oct 20 14:31:13 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1939218114',display_name='tempest-VolumesAssistedSnapshotsTest-server-1939218114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1939218114',id=7,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnGhGtTe3UC0KFgsNO0TPKMNe13aQgpugbhbaV9eq6uPpHnuGEbbZsyjKpTykw4QCKdKU/9o1KitTBkIMxL+TVgzgtDzEgVfsgNEq8r4jrwpMBS0C2EpxmV75pLkpSZHA==',key_name='tempest-keypair-1203971672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15cea561bd634daaa32c8dfcae4dcd8d',ramdisk_id='',reservation_id='r-5dso1j1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397347504',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397347504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5392ac9b049f428fbe6c571e447ed404',uuid=62254105-7623-4f3c-923b-f3cb7d304044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Converting VIF {"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG os_vif [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98aba2e0-69d5-52ec-87c3-8033f2024778', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5043bf-8e, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f5043bf-8e, col_values=(('qos', UUID('7b4c9a23-a274-4993-a1a9-e365be9926e8')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f5043bf-8e, col_values=(('external_ids', {'iface-id': '5f5043bf-8e48-4aa3-8b03-de18ff8ef62d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:28:f9', 'vm-uuid': '62254105-7623-4f3c-923b-f3cb7d304044'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:13 user nova-compute[76870]: INFO os_vif [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e')
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:31:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] No VIF found with MAC fa:16:3e:f5:28:f9, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:31:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updated VIF entry in instance network info cache for port 5f5043bf-8e48-4aa3-8b03-de18ff8ef62d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:31:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updating instance_info_cache with network_info: [{"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ed12d1a-5b71-4540-8fe8-913c495a4fa2 req-4f42942e-965c-45e0-943a-803f964c080c service nova] Releasing lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-b7a57ed0-be51-4e43-9eb5-16c02f074401 req-d51adb70-b6b7-4c5a-839e-100df1442e7c service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b7a57ed0-be51-4e43-9eb5-16c02f074401 req-d51adb70-b6b7-4c5a-839e-100df1442e7c service nova] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b7a57ed0-be51-4e43-9eb5-16c02f074401 req-d51adb70-b6b7-4c5a-839e-100df1442e7c service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b7a57ed0-be51-4e43-9eb5-16c02f074401 req-d51adb70-b6b7-4c5a-839e-100df1442e7c service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-b7a57ed0-be51-4e43-9eb5-16c02f074401 req-d51adb70-b6b7-4c5a-839e-100df1442e7c service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] No waiting events found dispatching network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:18 user nova-compute[76870]: WARNING nova.compute.manager [req-b7a57ed0-be51-4e43-9eb5-16c02f074401 req-d51adb70-b6b7-4c5a-839e-100df1442e7c service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received unexpected event network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 for instance with vm_state active and task_state None.
Oct 20 14:31:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 0 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:31:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Instance spawned successfully.
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:31:19 user nova-compute[76870]: INFO nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Took 8.46 seconds to spawn the instance on the hypervisor.
Oct 20 14:31:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:31:19 user nova-compute[76870]: INFO nova.compute.manager [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Took 9.75 seconds to build instance.
Oct 20 14:31:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4a47d45-3b84-466c-8d1f-eeaeb2496fd7 tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "62254105-7623-4f3c-923b-f3cb7d304044" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.910s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] No waiting events found dispatching network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:20 user nova-compute[76870]: WARNING nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received unexpected event network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 for instance with vm_state active and task_state None.
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] No waiting events found dispatching network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:20 user nova-compute[76870]: WARNING nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received unexpected event network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e for instance with vm_state active and task_state None.
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] No waiting events found dispatching network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:20 user nova-compute[76870]: WARNING nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received unexpected event network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e for instance with vm_state active and task_state None.
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] No waiting events found dispatching network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:20 user nova-compute[76870]: WARNING nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received unexpected event network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 for instance with vm_state active and task_state None.
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] No waiting events found dispatching network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:20 user nova-compute[76870]: WARNING nova.compute.manager [req-14bab498-d911-4c7d-a631-5ac96ede9b86 req-acbda3e9-460e-4abc-9eb2-eef73fac0bb2 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received unexpected event network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 for instance with vm_state active and task_state None.
Oct 20 14:31:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:31:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid a734d0c6-9dff-4254-9231-040de2c5eacc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:31:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-1e281843-566e-4f1b-87f0-f1f4af859e74 req-febd3d08-4892-4b5e-92dc-1999a93e9e27 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1e281843-566e-4f1b-87f0-f1f4af859e74 req-febd3d08-4892-4b5e-92dc-1999a93e9e27 service nova] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1e281843-566e-4f1b-87f0-f1f4af859e74 req-febd3d08-4892-4b5e-92dc-1999a93e9e27 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1e281843-566e-4f1b-87f0-f1f4af859e74 req-febd3d08-4892-4b5e-92dc-1999a93e9e27 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-1e281843-566e-4f1b-87f0-f1f4af859e74 req-febd3d08-4892-4b5e-92dc-1999a93e9e27 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] No waiting events found dispatching network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:25 user nova-compute[76870]: WARNING nova.compute.manager [req-1e281843-566e-4f1b-87f0-f1f4af859e74 req-febd3d08-4892-4b5e-92dc-1999a93e9e27 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received unexpected event network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e for instance with vm_state active and task_state None.
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] No waiting events found dispatching network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:27 user nova-compute[76870]: WARNING nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received unexpected event network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e for instance with vm_state active and task_state None.
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] No waiting events found dispatching network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:27 user nova-compute[76870]: WARNING nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received unexpected event network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 for instance with vm_state active and task_state None.
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] No waiting events found dispatching network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:27 user nova-compute[76870]: WARNING nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received unexpected event network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 for instance with vm_state active and task_state None.
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] No waiting events found dispatching network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:27 user nova-compute[76870]: WARNING nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received unexpected event network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d for instance with vm_state active and task_state None.
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] No waiting events found dispatching network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:31:27 user nova-compute[76870]: WARNING nova.compute.manager [req-e8581bd2-c11e-4fba-bdd2-dca3162c9cb0 req-a27ee436-b5b4-4027-ab44-229e4fd26225 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received unexpected event network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d for instance with vm_state active and task_state None.
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:28 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:28 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:31:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7787MB free_disk=25.630889892578125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:31:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a734d0c6-9dff-4254-9231-040de2c5eacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d44194ba-73e7-47f2-b2a8-fa157641a48c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance cc506fab-01ee-4944-b09f-f97fd0c21c77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 62254105-7623-4f3c-923b-f3cb7d304044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.100s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:31:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:31:48 user nova-compute[76870]: INFO nova.compute.claims [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Claim successful on node user
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:31:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:31:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:31:48 user nova-compute[76870]: INFO nova.virt.block_device [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Booting with volume 85145293-1072-4fa3-bfd2-91ed71a8cc83 at /dev/vda
Oct 20 14:31:48 user nova-compute[76870]: DEBUG nova.policy [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23df1790ab3d48c4b5b52c11b9b5bb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122b62cc9ab847fe847375a3b2150b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:31:48 user nova-compute[76870]: DEBUG os_brick.utils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:31:48 user nova-compute[76870]: INFO oslo.privsep.daemon [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpc78awf2o/privsep.sock']
Oct 20 14:31:48 user sudo[87636]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpc78awf2o/privsep.sock
Oct 20 14:31:48 user sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 14:31:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Successfully created port: bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:31:50 user sudo[87636]: pam_unix(sudo:session): session closed for user root
Oct 20 14:31:50 user nova-compute[76870]: INFO oslo.privsep.daemon [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Spawned new privsep daemon via rootwrap
Oct 20 14:31:50 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 14:31:50 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 14:31:50 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 14:31:50 user nova-compute[76870]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87639
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7b4ab-e993-4dbc-8a59-3654e8eb035e]: (2,) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Successfully updated port: bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquired lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-changed-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Refreshing instance network info cache due to event network-changed-bcfb2365-84e9-4fbb-9d41-cb6901931b1c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] Acquiring lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9394f66e-52d4-4024-a2e0-31a698e01225]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:31:50 user nova-compute[76870]: WARNING os_brick.initiator.connectors.nvmeof [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc9fe3-a5f3-4009-b516-a96bbbd28100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca815c48-525d-4b79-89a7-f90f0dd891a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f1a41-c9a2-40b4-afcd-62328ecadf60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:31:50 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef1fc4e-c07c-4bb1-9bed-ed643d05ccac]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG os_brick.utils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] <== get_connector_properties: return (1788ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updating existing volume attachment record: d2434a91-3121-40a2-9985-c92d20a25152 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updating instance_info_cache with network_info: [{"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Releasing lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance network_info: |[{"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] Acquired lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:31:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Refreshing network info cache for port bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:31:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updated VIF entry in instance network info cache for port bcfb2365-84e9-4fbb-9d41-cb6901931b1c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:31:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updating instance_info_cache with network_info: [{"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:31:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1cbf431-00bf-4b9f-83fa-80fb5d719561 req-ad301420-aa2e-4ab3-9fc3-fb67b1af9162 service nova] Releasing lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:31:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:31:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:31:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:31:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:31:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:31:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:32:07 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Creating image(s)
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Ensure instance console log exists: /opt/stack/data/nova/instances/92d2469d-6ab3-446e-be34-6a657448fc25/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Start _get_guest_xml network_info=[{"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd2434a91-3121-40a2-9985-c92d20a25152', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNUOJRPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92d2469d-6ab3-446e-be34-6a657448fc25', 'attached_at': '', 'detached_at': '', 'volume_id': '85145293-1072-4fa3-bfd2-91ed71a8cc83', 'serial': '85145293-1072-4fa3-bfd2-91ed71a8cc83'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:32:07 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:32:07 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connector [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Factory for ISCSI on None {{(pid=76870) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNUOJRPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:07 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:32:07 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:32:07 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda02dc-b3ce-4d24-8c7c-eef015f663d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:32:07 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddea7793-55a2-4899-a051-2b0c0cea228b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83] added
Oct 20 14:32:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f5b99-37f9-43ec-ae7e-3c90323ee52f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6488db-4f48-4b91-91b0-5df3d8ec645c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNUOJRPr {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNUOJRPr" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f49d91-9e50-483a-bdc7-3eff9ec48915]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uNUOJRPr'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cafae39-1dd8-46d6-9082-b339a33abc93]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[013877ae-0f6a-4145-86e4-0e1dda821fd1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:32:07 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:32:07 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:32:07 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 14:32:07 user nova-compute[76870]: 
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d53a71c-e6b9-4e8c-b2d6-299939540d25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260]
Oct 20 14:32:07 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260] successful.
Oct 20 14:32:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa1bd1-4da5-459e-9f02-2861b96a3b60]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab6b3d7-f256-4bd6-885b-f76599129c10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da0e51-eada-44e9-b8fc-4281f8e7208a]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:32:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNUOJRPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23535363036356566', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535363036356566', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-825684685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-825684685',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8PQcQNpcaMeuR3Tbq+ugMSrAL3pjWKxDw6zJHwmogZCJUZKwHNcGeLNciZdqccQ89uBsi4Zws2NoA9QS07uGH0kSxae1Btu3OThNA10ueYWROzhSVNn77/jEFKFYkJRw==',key_name='tempest-keypair-1411999794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='122b62cc9ab847fe847375a3b2150b43',ramdisk_id='',reservation_id='r-nt9wz1ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-279014424',owner_user_name='tempest-ServerActionsV293TestJSON-279014424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23df1790ab3d48c4b5b52c11b9b5bb30',uuid=92d2469d-6ab3-446e-be34-6a657448fc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converting VIF {"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.objects.instance [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lazy-loading 'pci_devices' on Instance uuid 92d2469d-6ab3-446e-be34-6a657448fc25 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:32:08 user nova-compute[76870]:   <uuid>92d2469d-6ab3-446e-be34-6a657448fc25</uuid>
Oct 20 14:32:08 user nova-compute[76870]:   <name>instance-00000008</name>
Oct 20 14:32:08 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:32:08 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:32:08 user nova-compute[76870]:   <metadata>
Oct 20 14:32:08 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:32:08 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:32:08 user nova-compute[76870]:       <nova:name>tempest-ServerActionsV293TestJSON-server-825684685</nova:name>
Oct 20 14:32:08 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:32:07</nova:creationTime>
Oct 20 14:32:08 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:32:08 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:32:08 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:32:08 user nova-compute[76870]:       <nova:owner>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:user uuid="23df1790ab3d48c4b5b52c11b9b5bb30">tempest-ServerActionsV293TestJSON-279014424-project-member</nova:user>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:project uuid="122b62cc9ab847fe847375a3b2150b43">tempest-ServerActionsV293TestJSON-279014424</nova:project>
Oct 20 14:32:08 user nova-compute[76870]:       </nova:owner>
Oct 20 14:32:08 user nova-compute[76870]:       <nova:ports>
Oct 20 14:32:08 user nova-compute[76870]:         <nova:port uuid="bcfb2365-84e9-4fbb-9d41-cb6901931b1c">
Oct 20 14:32:08 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:32:08 user nova-compute[76870]:         </nova:port>
Oct 20 14:32:08 user nova-compute[76870]:       </nova:ports>
Oct 20 14:32:08 user nova-compute[76870]:     </nova:instance>
Oct 20 14:32:08 user nova-compute[76870]:   </metadata>
Oct 20 14:32:08 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:32:08 user nova-compute[76870]:     <system>
Oct 20 14:32:08 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:32:08 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:32:08 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:32:08 user nova-compute[76870]:       <entry name="serial">92d2469d-6ab3-446e-be34-6a657448fc25</entry>
Oct 20 14:32:08 user nova-compute[76870]:       <entry name="uuid">92d2469d-6ab3-446e-be34-6a657448fc25</entry>
Oct 20 14:32:08 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:32:08 user nova-compute[76870]:     </system>
Oct 20 14:32:08 user nova-compute[76870]:   </sysinfo>
Oct 20 14:32:08 user nova-compute[76870]:   <os>
Oct 20 14:32:08 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:32:08 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:32:08 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:32:08 user nova-compute[76870]:   </os>
Oct 20 14:32:08 user nova-compute[76870]:   <features>
Oct 20 14:32:08 user nova-compute[76870]:     <acpi/>
Oct 20 14:32:08 user nova-compute[76870]:     <apic/>
Oct 20 14:32:08 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:32:08 user nova-compute[76870]:   </features>
Oct 20 14:32:08 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:32:08 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:32:08 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:32:08 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:32:08 user nova-compute[76870]:   </clock>
Oct 20 14:32:08 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:32:08 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:32:08 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:32:08 user nova-compute[76870]:   </cpu>
Oct 20 14:32:08 user nova-compute[76870]:   <devices>
Oct 20 14:32:08 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:32:08 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:32:08 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 14:32:08 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:32:08 user nova-compute[76870]:       <serial>85145293-1072-4fa3-bfd2-91ed71a8cc83</serial>
Oct 20 14:32:08 user nova-compute[76870]:     </disk>
Oct 20 14:32:08 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:32:08 user nova-compute[76870]:       <mac address="fa:16:3e:90:f1:e4"/>
Oct 20 14:32:08 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:32:08 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:32:08 user nova-compute[76870]:       <target dev="tapbcfb2365-84"/>
Oct 20 14:32:08 user nova-compute[76870]:     </interface>
Oct 20 14:32:08 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:32:08 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/92d2469d-6ab3-446e-be34-6a657448fc25/console.log" append="off"/>
Oct 20 14:32:08 user nova-compute[76870]:     </serial>
Oct 20 14:32:08 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:32:08 user nova-compute[76870]:     <video>
Oct 20 14:32:08 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:32:08 user nova-compute[76870]:     </video>
Oct 20 14:32:08 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:32:08 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:32:08 user nova-compute[76870]:     </rng>
Oct 20 14:32:08 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:32:08 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:32:08 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:32:08 user nova-compute[76870]:     </memballoon>
Oct 20 14:32:08 user nova-compute[76870]:   </devices>
Oct 20 14:32:08 user nova-compute[76870]: </domain>
Oct 20 14:32:08 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-825684685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-825684685',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8PQcQNpcaMeuR3Tbq+ugMSrAL3pjWKxDw6zJHwmogZCJUZKwHNcGeLNciZdqccQ89uBsi4Zws2NoA9QS07uGH0kSxae1Btu3OThNA10ueYWROzhSVNn77/jEFKFYkJRw==',key_name='tempest-keypair-1411999794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='122b62cc9ab847fe847375a3b2150b43',ramdisk_id='',reservation_id='r-nt9wz1ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-279014424',owner_user_name='tempest-ServerActionsV293TestJSON-279014424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23df1790ab3d48c4b5b52c11b9b5bb30',uuid=92d2469d-6ab3-446e-be34-6a657448fc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converting VIF {"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG os_vif [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0e22a96-c71d-5690-8f3b-7492e24336b6', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcfb2365-84, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcfb2365-84, col_values=(('qos', UUID('63ef9ed2-9122-49a1-bf81-f18ce4b520b4')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcfb2365-84, col_values=(('external_ids', {'iface-id': 'bcfb2365-84e9-4fbb-9d41-cb6901931b1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:f1:e4', 'vm-uuid': '92d2469d-6ab3-446e-be34-6a657448fc25'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:08 user nova-compute[76870]: INFO os_vif [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84')
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:32:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] No VIF found with MAC fa:16:3e:90:f1:e4, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-56c0baa4-9e85-4caa-8751-cc6128021565 req-199b3883-21dc-4a43-801d-3974e3a7c496 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56c0baa4-9e85-4caa-8751-cc6128021565 req-199b3883-21dc-4a43-801d-3974e3a7c496 service nova] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56c0baa4-9e85-4caa-8751-cc6128021565 req-199b3883-21dc-4a43-801d-3974e3a7c496 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56c0baa4-9e85-4caa-8751-cc6128021565 req-199b3883-21dc-4a43-801d-3974e3a7c496 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-56c0baa4-9e85-4caa-8751-cc6128021565 req-199b3883-21dc-4a43-801d-3974e3a7c496 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] No waiting events found dispatching network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:32:10 user nova-compute[76870]: WARNING nova.compute.manager [req-56c0baa4-9e85-4caa-8751-cc6128021565 req-199b3883-21dc-4a43-801d-3974e3a7c496 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received unexpected event network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c for instance with vm_state building and task_state spawning.
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:32:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance spawned successfully.
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-f1bf0192-8885-4fc3-a81e-28dc94a3e2e6 req-36d2ee43-d53d-43ff-81fb-b31db9ed0dc6 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f1bf0192-8885-4fc3-a81e-28dc94a3e2e6 req-36d2ee43-d53d-43ff-81fb-b31db9ed0dc6 service nova] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f1bf0192-8885-4fc3-a81e-28dc94a3e2e6 req-36d2ee43-d53d-43ff-81fb-b31db9ed0dc6 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f1bf0192-8885-4fc3-a81e-28dc94a3e2e6 req-36d2ee43-d53d-43ff-81fb-b31db9ed0dc6 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-f1bf0192-8885-4fc3-a81e-28dc94a3e2e6 req-36d2ee43-d53d-43ff-81fb-b31db9ed0dc6 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] No waiting events found dispatching network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:32:12 user nova-compute[76870]: WARNING nova.compute.manager [req-f1bf0192-8885-4fc3-a81e-28dc94a3e2e6 req-36d2ee43-d53d-43ff-81fb-b31db9ed0dc6 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received unexpected event network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c for instance with vm_state building and task_state spawning.
Oct 20 14:32:12 user nova-compute[76870]: INFO nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 20 14:32:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:32:12 user nova-compute[76870]: INFO nova.compute.manager [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Took 24.45 seconds to build instance.
Oct 20 14:32:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0fd57e93-1e5b-4094-b6a1-701261017e34 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.557s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:32:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:32:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:32:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:32:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:32:19 user nova-compute[76870]: INFO nova.compute.claims [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Claim successful on node user
Oct 20 14:32:19 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:32:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:32:20 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:32:20 user nova-compute[76870]: INFO nova.virt.block_device [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Booting with volume 92d77c6b-4c27-4457-8504-72a0269428a0 at /dev/vda
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.policy [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd054f71a7f134e5e9c8989fda21ff6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026fac370fef4694a8f7783536f16d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG os_brick.utils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35640b-c0ec-4434-adc8-6396bed8d5ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[456e950b-47f6-4a8c-97f2-a56e2c183076]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e34b1-84aa-447b-b5a5-143b941acf6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd3f39-c10f-4cea-9973-ab102d2ee701]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:20 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:32:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e28530-5e41-46ab-89b3-0b72f44a5cb8]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG os_brick.utils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating existing volume attachment record: 277f5610-b174-4fe7-bc08-b95ebd015c68 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:32:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully created port: da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:32:21 user nova-compute[76870]: INFO nova.compute.claims [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Claim successful on node user
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully created port: 2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:32:21 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:32:21 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:32:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully created port: ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:22 user nova-compute[76870]: INFO nova.virt.block_device [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Booting with volume a6232a67-b577-44c6-b385-fd18db4d0984 at /dev/vda
Oct 20 14:32:22 user nova-compute[76870]: DEBUG nova.policy [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef3ed46cbe0a41e48a560c18c8733f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ae9c6a9c114b5b811c6f6c77aac86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG os_brick.utils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6fb64e-5fa6-4c4d-ab30-534c5025ed95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6987215-9d5d-4749-9304-03361cd38565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[48304e36-57c0-490d-9574-aaeab9e3e341]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b7fbbf-1556-4bbf-be91-65e231fbab61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:22 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2814917-5b78-4e49-9c98-75e9c7fa9980]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG os_brick.utils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating existing volume attachment record: 24792ed0-5054-4862-9482-3e387ae17c11 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully created port: 6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully created port: 44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully created port: b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully created port: 990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully created port: d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-da0116b9-289d-49cd-838e-ca41dd4fc65c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG nova.network.neutron [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG nova.network.neutron [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully created port: 34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG nova.network.neutron [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7743d53a-8eef-4158-9e47-ee109109c960 req-b9640eb4-d38b-40e7-9496-51c53cee6afe service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG nova.compute.manager [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-changed-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG nova.compute.manager [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Refreshing instance network info cache due to event network-changed-a15cefc7-71b8-4c86-bf3d-ab69e98d6914. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] Acquiring lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] Acquired lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG nova.network.neutron [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Refreshing network info cache for port a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: 9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully created port: eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updated VIF entry in instance network info cache for port a15cefc7-71b8-4c86-bf3d-ab69e98d6914. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-542973d8-0ef1-48e5-a7ce-1c1a45577421 req-e5081420-fdea-4e6d-9aa0-e71a4c83d4e1 service nova] Releasing lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-9dc70403-ae2b-4e23-9994-acb5e04ba8a9. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port 9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: 44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: 32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-44c4be28-1456-4293-b59e-dc6ecf5d2bf2. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.network.neutron [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port 44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:32:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:32:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.560073852539062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a734d0c6-9dff-4254-9231-040de2c5eacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d44194ba-73e7-47f2-b2a8-fa157641a48c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance cc506fab-01ee-4944-b09f-f97fd0c21c77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 62254105-7623-4f3c-923b-f3cb7d304044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 122e112c-ed24-4206-bbc0-2e9c0feca923 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19cd9302-e823-4fd1-bcc1-c4af16a0d808 req-9218addf-6c14-49c6-a9d3-67989788148a service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3fe6ad3f-74f1-4926-9124-baac9e3667e8 req-f383abf6-27bf-4692-affe-549fabff5bc0 service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: 2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-32a4ac34-1e52-400d-884e-536bb1640f0e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port 32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-e0a3fe71-4e0f-4cd7-80e7-5191c9397469. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: 1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-2ee65f9a-2440-4423-b4a1-cbd24656d6be. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port 2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e8a00d0b-c47b-4fe6-a56a-34807b5932a6 req-a562a318-8813-4fd4-834c-a46988a68277 service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: 6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-ece05121-0eef-4d74-b9e9-c9e95c71fb61. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f6f252ca-169d-4909-a101-a0b3c79b8061 req-fa188bcc-84a9-4940-8bb4-3d690a35814e service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updating instance_info_cache with network_info: [{"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d44194ba-73e7-47f2-b2a8-fa157641a48c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: 990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lazy-loading 'flavor' on Instance uuid d44194ba-73e7-47f2-b2a8-fa157641a48c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:31 user nova-compute[76870]: INFO nova.compute.manager [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Attaching volume 45b07ae2-214e-4191-9dcd-42337a0b77a3 to /dev/vdb
Oct 20 14:32:31 user nova-compute[76870]: DEBUG os_brick.utils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79046be-dc1b-421a-a34b-d32fc152cb9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-1bb94220-5586-400e-844c-6a83087ce4f1. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port 1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[df54c134-0968-40d3-9281-79dcee812c67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a549d-73d2-4b0e-b537-49c1e81331aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a9b2e-33e3-49cc-a8ed-a656561b331f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:31 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[005fe864-d555-4a22-8b26-53ff686aaf05]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG os_brick.utils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updating existing volume attachment record: 87938609-d38e-4e35-a62a-5bebe482e805 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Successfully updated port: b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-6a3e9c7b-9789-4d8b-a41f-1189add63dce. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-990044fc-5a03-4382-8c07-403709389e6e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port 990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-619d8a3f-eab2-4eee-8437-646acd08e74d req-bcda5f98-04bf-4f46-a412-9167105732e7 service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-changed-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Refreshing instance network info cache due to event network-changed-fa79a316-749b-41e5-811d-c28cdd5ae51e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Refreshing network info cache for port fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated VIF entry in instance network info cache for port fa79a316-749b-41e5-811d-c28cdd5ae51e. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-996ccd56-2509-44a3-9b3e-6fe357e4bd62 req-e5a677bc-8680-4890-9eac-6ee3f9c866dc service nova] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-b9165885-92ad-4c7c-aa4f-574594dd2913. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:33 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: 34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Successfully updated port: eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance network_info: |[{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.network.neutron [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port 6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updated VIF entry in instance network info cache for port 6a3e9c7b-9789-4d8b-a41f-1189add63dce. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ed4dc1ad-fb91-4e61-8aed-b21db7bbb349 req-fa37e481-439a-48e3-b3c3-83fdb91ea6b7 service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updated VIF entry in instance network info cache for port b9165885-92ad-4c7c-aa4f-574594dd2913. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-d78f5177-7d40-4ce0-ac07-63126fa6d312. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance network_info: |[{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:32:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port 34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updated VIF entry in instance network info cache for port 34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.compute.manager [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.compute.manager [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-eefb9952-705b-4911-b643-7f7ddbcbc0b7. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updated VIF entry in instance network info cache for port eefb9952-705b-4911-b643-7f7ddbcbc0b7. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c712bf89-7652-4af8-b9a5-ec2b56734a11 req-e15b2082-2aae-48e6-af66-0de253f23e5d service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updated VIF entry in instance network info cache for port d78f5177-7d40-4ce0-ac07-63126fa6d312. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f9ad0f78-4299-44df-9f17-4953f7a27eba req-cbc23da5-6784-4424-a58a-4ca8727f853f service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:40 user nova-compute[76870]: INFO nova.virt.block_device [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Booting with volume 5049d394-b020-4e03-9319-5bb8c46ada68 at /dev/vdb
Oct 20 14:32:40 user nova-compute[76870]: DEBUG os_brick.utils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[79515f95-34d2-4ffd-a3d7-26cbb56a2a52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[939d4b80-e6c8-42fc-9f55-428c92b1dad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab63b5-f5e7-4d51-ab8c-492eb93e0d7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489645a-3c30-42aa-931c-ca31fc66f5f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:40 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:32:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9403ec-2bda-43ce-9d10-7a0af27a726a]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG os_brick.utils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:40 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating existing volume attachment record: e344f420-6713-40b2-a733-575bf0196bd9 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:32:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-changed-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Refreshing instance network info cache due to event network-changed-9efda0d6-1c7b-4233-9206-e83e5661af3e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] Acquiring lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] Acquired lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Refreshing network info cache for port 9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updated VIF entry in instance network info cache for port 9efda0d6-1c7b-4233-9206-e83e5661af3e. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating instance_info_cache with network_info: [{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27b8bb99-54e3-4e50-b731-985e119da339 req-fca91ebe-0b1b-49a3-9516-dc83ac6c14a5 service nova] Releasing lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:47 user nova-compute[76870]: INFO nova.virt.block_device [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Booting with volume 6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd at /dev/vdb
Oct 20 14:32:47 user nova-compute[76870]: DEBUG os_brick.utils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f707040-0eb4-4dd7-97c2-e5edf53d3d18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[483da492-2287-42e4-9a5a-79c39ffc2914]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b27a90b-f227-44c6-9b17-a6b1a3ed754f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e860be-6a48-4884-abdd-77e8ab509da9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:48 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:32:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24afcbd-deff-4a9b-9628-556189528fe7]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG os_brick.utils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating existing volume attachment record: 1e3c1124-9e35-4659-8586-ebbd6b9f073e {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcCLujYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:49 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:32:49 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:32:49 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dafc68-a68e-4a4a-ac63-b1a2108eb1cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:32:49 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f7c2f-4406-4574-8b85-0a1842d55a5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3] added
Oct 20 14:32:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14dcab9-ec8b-462d-8d94-80327060e978]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87954ac-0b9e-4fe8-8428-ef228ef816b4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcCLujYE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcCLujYE" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[342aaefa-becb-46d5-8ccb-b4b15d1faad5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hcCLujYE'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ddeaab-650f-4d46-80c0-a6d7cb94019e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-changed-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Refreshing instance network info cache due to event network-changed-95871811-8a03-4445-9469-aa9fe96bcdd9. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] Acquiring lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] Acquired lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG nova.network.neutron [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Refreshing network info cache for port 95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f444fcf-5bd5-41ff-8496-a92d5480b9bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ca077-7b9e-4bad-853a-ece379e9262f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260]
Oct 20 14:32:49 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260] successful.
Oct 20 14:32:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6345f9a-9a66-4783-92fa-5c20cb482b47]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8fc0f-9dae-404a-b53c-ad5023ec7a70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:49 user nova-compute[76870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 (non-flash)
Oct 20 14:32:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:49 user nova-compute[76870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 (non-flash)
Oct 20 14:32:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1cfe24-3b31-4b45-a1e8-2679b2eb1349]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:32:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcCLujYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updated VIF entry in instance network info cache for port 95871811-8a03-4445-9469-aa9fe96bcdd9. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updating instance_info_cache with network_info: [{"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e73957a-727c-4a20-adc8-235fe946581d req-601579e2-3a5f-45f3-821a-be16d71d8129 service nova] Releasing lock "refresh_cache-cc506fab-01ee-4944-b09f-f97fd0c21c77" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23566393534313534', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566393534313534', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lazy-loading 'flavor' on Instance uuid d44194ba-73e7-47f2-b2a8-fa157641a48c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:32:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:32:50 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:32:50 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:32:50 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:32:50 user nova-compute[76870]:   <serial>45b07ae2-214e-4191-9dcd-42337a0b77a3</serial>
Oct 20 14:32:50 user nova-compute[76870]: </disk>
Oct 20 14:32:50 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] No VIF found with MAC fa:16:3e:f2:0a:33, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c20b55d3-556c-41ad-a5b8-1b862e8b1ee1 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.307s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:52 user nova-compute[76870]: INFO nova.compute.manager [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Terminating instance
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-02b22d57-36a8-41c7-a11d-3e6371164cb5 req-593251d5-c09d-4615-94d2-a874e39dfcdc service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-vif-unplugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-02b22d57-36a8-41c7-a11d-3e6371164cb5 req-593251d5-c09d-4615-94d2-a874e39dfcdc service nova] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-02b22d57-36a8-41c7-a11d-3e6371164cb5 req-593251d5-c09d-4615-94d2-a874e39dfcdc service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-02b22d57-36a8-41c7-a11d-3e6371164cb5 req-593251d5-c09d-4615-94d2-a874e39dfcdc service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-02b22d57-36a8-41c7-a11d-3e6371164cb5 req-593251d5-c09d-4615-94d2-a874e39dfcdc service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] No waiting events found dispatching network-vif-unplugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-02b22d57-36a8-41c7-a11d-3e6371164cb5 req-593251d5-c09d-4615-94d2-a874e39dfcdc service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-vif-unplugged-acd2d180-ce3c-4f57-83c1-704e124462a9 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Instance destroyed successfully.
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lazy-loading 'resources' on Instance uuid d44194ba-73e7-47f2-b2a8-fa157641a48c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-638187570',display_name='tempest-DeleteServersTestJSON-server-638187570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-638187570',id=2,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0650260e127f4b40863f4c9cdc9bb9f2',ramdisk_id='',reservation_id='r-12mg5btq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-681628364',owner_user_name='tempest-DeleteServersTestJSON-681628364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:30:53Z,user_data=None,user_id='5812ebf47e564eedbd34d30333ea45f2',uuid=d44194ba-73e7-47f2-b2a8-fa157641a48c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Converting VIF {"id": "acd2d180-ce3c-4f57-83c1-704e124462a9", "address": "fa:16:3e:f2:0a:33", "network": {"id": "88588946-6180-4e49-b501-0510e6bb968f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-792344152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0650260e127f4b40863f4c9cdc9bb9f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacd2d180-ce", "ovs_interfaceid": "acd2d180-ce3c-4f57-83c1-704e124462a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_vif [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacd2d180-ce, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e463eeb-1e34-41f5-854f-c48899c061a6) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:32:52 user nova-compute[76870]: INFO os_vif [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0a:33,bridge_name='br-int',has_traffic_filtering=True,id=acd2d180-ce3c-4f57-83c1-704e124462a9,network=Network(88588946-6180-4e49-b501-0510e6bb968f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacd2d180-ce')
Oct 20 14:32:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcCLujYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:52 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd43d71c-dabd-47bb-8cfa-58c0471098fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:32:52 user nova-compute[76870]: No targets found.
Oct 20 14:32:52 user nova-compute[76870]: iSNS:
Oct 20 14:32:52 user nova-compute[76870]: No targets found.
Oct 20 14:32:52 user nova-compute[76870]: STATIC:
Oct 20 14:32:52 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83
Oct 20 14:32:52 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:32:52 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:32:52 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3
Oct 20 14:32:52 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:32:52 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:32:52 user nova-compute[76870]: FIRMWARE:
Oct 20 14:32:52 user nova-compute[76870]: No targets found.
Oct 20 14:32:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:32:52 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:32:52 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372fa45-0086-41fc-97fb-612e15f0f437]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa07f51-002b-44e2-873f-09f0eacdb427]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:53 user nova-compute[76870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 (non-flash)
Oct 20 14:32:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:32:53 user nova-compute[76870]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 (non-flash)
Oct 20 14:32:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c473760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[679e4924-8bb5-4ccc-aed2-6d6e8f4a7b80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[791eef10-40ba-4b0b-88a8-0e59d09a23d3]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lazy-loading 'flavor' on Instance uuid d03d6cc9-1e71-49a9-aaae-f1ec46254200 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba18cb-90dd-47c0-9957-3712f3bfbc58]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666f05d-c1ae-4b8b-8635-61a9583f2c5d]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787dd34-602f-47ae-ba40-e8b011d76a40]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efff955-7d12-4e31-95b9-5a43579736eb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260]
Oct 20 14:32:53 user nova-compute[76870]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3, portal: 172.16.0.220,3260] successful.
Oct 20 14:32:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b07ae2-214e-4191-9dcd-42337a0b77a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8825024a-ed95-4b5c-bcf3-b03644a130d1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] <== disconnect_volume: return (336ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:32:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Deleting instance files /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c_del
Oct 20 14:32:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Deletion of /opt/stack/data/nova/instances/d44194ba-73e7-47f2-b2a8-fa157641a48c_del complete
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Checking UEFI support for host arch (x86_64) {{(pid=76870) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 14:32:53 user nova-compute[76870]: INFO nova.virt.libvirt.host [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] UEFI support detected
Oct 20 14:32:53 user nova-compute[76870]: INFO nova.compute.manager [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:53 user nova-compute[76870]: INFO nova.compute.manager [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Attaching volume 3cd18519-25de-4b38-bf2a-ab6b550a803a to /dev/vdb
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.utils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac4219-7496-4869-b9dc-ced59d1b5b1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402f209-ec8c-435f-a913-9f1bafc5c2fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75718904-843b-48f3-826f-63db0215a80f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab86d54c-b150-4c5f-9a84-f6f5df930fb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:32:53 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[069464ff-906c-41be-a49f-c4628b3e42dc]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG os_brick.utils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating existing volume attachment record: ec82dc34-c9c0-4e6b-b1e9-d9e12fe5ff63 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-changed-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Refreshing instance network info cache due to event network-changed-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] Acquiring lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] Acquired lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:32:53 user nova-compute[76870]: DEBUG nova.network.neutron [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Refreshing network info cache for port f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-1d7877a8-bfe4-4fe0-8589-cb30ed47856d req-d221422d-b5c3-4169-aae8-9c069a4df87c service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1d7877a8-bfe4-4fe0-8589-cb30ed47856d req-d221422d-b5c3-4169-aae8-9c069a4df87c service nova] Acquiring lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1d7877a8-bfe4-4fe0-8589-cb30ed47856d req-d221422d-b5c3-4169-aae8-9c069a4df87c service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1d7877a8-bfe4-4fe0-8589-cb30ed47856d req-d221422d-b5c3-4169-aae8-9c069a4df87c service nova] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-1d7877a8-bfe4-4fe0-8589-cb30ed47856d req-d221422d-b5c3-4169-aae8-9c069a4df87c service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] No waiting events found dispatching network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:32:54 user nova-compute[76870]: WARNING nova.compute.manager [req-1d7877a8-bfe4-4fe0-8589-cb30ed47856d req-d221422d-b5c3-4169-aae8-9c069a4df87c service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received unexpected event network-vif-plugged-acd2d180-ce3c-4f57-83c1-704e124462a9 for instance with vm_state active and task_state deleting.
Oct 20 14:32:54 user nova-compute[76870]: DEBUG nova.network.neutron [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updated VIF entry in instance network info cache for port f48d0946-3b64-46f8-93ae-5e7fafa9f0f4. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG nova.network.neutron [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updating instance_info_cache with network_info: [{"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ace02101-0e07-4c03-bbb1-5e66929f2323 req-1e631270-af26-43d0-be1e-ce89ca781014 service nova] Releasing lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:32:54 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:32:54 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Took 1.35 seconds to deallocate network for instance.
Oct 20 14:32:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-1e08f1fb-99f4-4403-8c1d-85f712f2ace5 req-8d1c7e30-2cfe-485d-b294-cf605e44bdde service nova] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Received event network-vif-deleted-acd2d180-ce3c-4f57-83c1-704e124462a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:32:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:32:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:32:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:32:59 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lazy-loading 'flavor' on Instance uuid b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:32:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-changed-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Refreshing instance network info cache due to event network-changed-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] Acquiring lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] Acquired lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Refreshing network info cache for port 5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:33:00 user nova-compute[76870]: INFO nova.compute.manager [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] [instance: d44194ba-73e7-47f2-b2a8-fa157641a48c] Took 5.34 seconds to detach 1 volumes for instance.
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:00 user nova-compute[76870]: INFO nova.virt.block_device [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Booting with volume 4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 at /dev/vdc
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lazy-loading 'flavor' on Instance uuid cc506fab-01ee-4944-b09f-f97fd0c21c77 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "62254105-7623-4f3c-923b-f3cb7d304044" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.objects.instance [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lazy-loading 'flavor' on Instance uuid 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.volume.cinder [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Update attachment failed for attachment ec82dc34-c9c0-4e6b-b1e9-d9e12fe5ff63. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cc40015f-9c85-4473-a67c-ea18ef979496) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cc40015f-9c85-4473-a67c-ea18ef979496)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Failed to attach 3cd18519-25de-4b38-bf2a-ab6b550a803a at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cc40015f-9c85-4473-a67c-ea18ef979496)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Traceback (most recent call last):
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     self._volume_attach(context, volume, connector, instance,
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     connection_info = volume_api.attachment_update(
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     res = method(self, ctx, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     with excutils.save_and_reraise_exception():
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     self.force_reraise()
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     raise self.value
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     return method.func(obj, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     return self.request(url, method, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200]     raise exceptions.from_response(resp, body)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cc40015f-9c85-4473-a67c-ea18ef979496)
Oct 20 14:33:00 user nova-compute[76870]: ERROR nova.compute.manager [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] 
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "62254105-7623-4f3c-923b-f3cb7d304044" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.utils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:00 user nova-compute[76870]: INFO nova.compute.manager [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Attaching volume 09597554-9085-4f07-b262-2256a027aac8 to /dev/vdb
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f754eaea-3853-4bfa-9dc8-15630b5df69d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updated VIF entry in instance network info cache for port 5f5043bf-8e48-4aa3-8b03-de18ff8ef62d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updating instance_info_cache with network_info: [{"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[849df698-3024-4f62-b6df-694166979195]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cc602836-d23d-421a-9d79-c6f32aa47858 req-ca2c33ec-c34a-4a27-84e3-c5a1443b1511 service nova] Releasing lock "refresh_cache-62254105-7623-4f3c-923b-f3cb7d304044" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4df48-0f7e-40dd-a157-2311916098e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[974c4de8-028c-42fc-99b1-f824ec72eb27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:00 user nova-compute[76870]: INFO nova.compute.manager [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Attaching volume dab79a92-c729-441d-af33-286489ef36b4 to /dev/sdc
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.316s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:00 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5eda2f-1d2f-42ba-8099-ddabfe1c6f94]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.utils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating existing volume attachment record: c9afa47a-df6e-4255-b46a-c0f84f845410 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:33:00 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Deleted allocations for instance d44194ba-73e7-47f2-b2a8-fa157641a48c
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-ec5a2a35-5007-4e36-8763-bad37e43d130 tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cc40015f-9c85-4473-a67c-ea18ef979496)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cc40015f-9c85-4473-a67c-ea18ef979496)
Oct 20 14:33:00 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.utils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "62254105-7623-4f3c-923b-f3cb7d304044" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:00 user nova-compute[76870]: INFO nova.compute.manager [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Attaching volume 653fde4c-7895-425f-beae-2daf9caee86a to /dev/vdb
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521bb92-ea6c-4abf-91ca-36287cbebf6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52185d83-5778-4eee-923f-7bc7b3ba13fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8988064a-2fc8-4df5-a6eb-d11398b38516 tempest-DeleteServersTestJSON-681628364 tempest-DeleteServersTestJSON-681628364-project-member] Lock "d44194ba-73e7-47f2-b2a8-fa157641a48c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.918s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.utils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[73768657-f5cc-4b3c-9127-e541ec274996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc76d0-98bc-4a87-a80c-83bd23dcced3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c16d85-52a2-4a09-8357-e512ffd269d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2decb73-ff8b-4500-bd93-e21c96a81415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:00 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[332273fb-4f99-4453-b845-ab2e65dded6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:01 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[404bee71-088c-4c1f-8ffc-4076861d59a6]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updating existing volume attachment record: 53670139-bf6f-4ffd-8675-8b88637cd1ef {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbaa89b-d4c7-4f35-a156-8b971ee9fc8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b0bffd-ac6f-410e-95b8-a7c0567ec808]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9060f1-d039-4622-93c7-aefd8b248f62]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updating existing volume attachment record: fa8a892e-31e9-4b7e-91ac-5a0b98c77479 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1d1ce-cbad-4553-9531-9bcd254679e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32505e-e7af-4b87-9855-d5e1b15cbd49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0693f-e5a7-4ae7-905f-087dda383891]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:01 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:33:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade964d4-3c5a-4a26-b288-ea2b90023d4b]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:01 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updating existing volume attachment record: b49bae7b-09dc-41b7-bb6b-07d5cdc359d0 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:33:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxfMwkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:19 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:19 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:19 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fa441-ad56-4f0c-8774-9df26e6b634a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:19 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb46272-d785-489a-9720-68437cedba4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8] added
Oct 20 14:33:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668aded-f8f1-4177-9a9a-c693091351e0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c329d4-a70c-48fb-9739-c4ac17b2e219]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWxfMwkG {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWxfMwkG" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[177df63d-f373-4d66-872b-83ad126675e8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWxfMwkG'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2445a4-150c-475c-94ef-817096a9207b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6864e3-8ec1-4eda-9235-da604a3cd79c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84ae45e-ee53-4dad-b7ba-bbce61b64024]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260]
Oct 20 14:33:19 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2572a13-9733-46e9-b644-580a3bcb74a1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c03024-6347-442c-8abb-144fede19401]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:19 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:19 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd7339-fe42-4345-96a8-b21c99194a54]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxfMwkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:19 user nova-compute[76870]: INFO nova.virt.block_device [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Booting with volume 741b4dcc-b82e-4af7-9601-d21d82356fbf at /dev/vdc
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.utils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:33:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Creating image(s)
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Ensure instance console log exists: /opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Start _get_guest_xml network_info=[{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '277f5610-b174-4fe7-bc08-b95ebd015c68', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuyklCsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '122e112c-ed24-4206-bbc0-2e9c0feca923', 'attached_at': '', 'detached_at': '', 'volume_id': '92d77c6b-4c27-4457-8504-72a0269428a0', 'serial': '92d77c6b-4c27-4457-8504-72a0269428a0'}, 'volume_type': None}, {'attachment_id': 'e344f420-6713-40b2-a733-575bf0196bd9', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNFgKilW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '122e112c-ed24-4206-bbc0-2e9c0feca923', 'attached_at': '', 'detached_at': '', 'volume_id': '5049d394-b020-4e03-9319-5bb8c46ada68', 'serial': '5049d394-b020-4e03-9319-5bb8c46ada68'}, 'volume_type': None}, {'attachment_id': 'c9afa47a-df6e-4255-b46a-c0f84f845410', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAvlWFTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '122e112c-ed24-4206-bbc0-2e9c0feca923', 'attached_at': '', 'detached_at': '', 'volume_id': '4d616ccc-29a7-4c36-bb20-ee3ee32b93d5', 'serial': '4d616ccc-29a7-4c36-bb20-ee3ee32b93d5'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81006ab-f94a-4ca2-a47d-9a85b82a37df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:33:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuyklCsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:19 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4043c-c97f-457b-ae10-62d57ed858fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15251bdb-26cb-4491-8e81-aee2ad38111b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b5dcc2-a42e-4762-b37f-4bac31299315]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:20 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8e310-b43a-4335-9e8c-8badee8f3869]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.utils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating existing volume attachment record: 17b32573-1b77-420f-8c06-3bc7e1b7471c {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23031336432643733', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031336432643733', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.779s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:20 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:20 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lazy-loading 'flavor' on Instance uuid b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6129ba-5f67-4284-8b05-f4b59d14c29a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:20 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:33:20 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:20 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:33:20 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:33:20 user nova-compute[76870]:   <serial>09597554-9085-4f07-b262-2256a027aac8</serial>
Oct 20 14:33:20 user nova-compute[76870]: </disk>
Oct 20 14:33:20 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1671d9-c95d-4cbf-8c9b-ef9ddb86d016]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0] added
Oct 20 14:33:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a24480-4801-4ea5-ba0e-8fd1027e4023]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.066s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f6350-91be-4c46-9b54-a3d0f2a81558]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuyklCsR {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuyklCsR" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c0ad08-a478-4041-9986-076f836b8a51]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WuyklCsR'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce5e503-ef31-4c25-99f5-9d0c089a97ad]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da74e85-2214-4594-ba49-b0bef939ba30]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032d9db-f7b3-4366-9a53-f320185c67b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260]
Oct 20 14:33:21 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fa510d-4c7e-43fc-8b96-c6006350041b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1571036-a9ad-4b3f-b670-796480917bbf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8347bb87-f7f3-4aa5-96b0-364065e39928]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuyklCsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] No VIF found with MAC fa:16:3e:22:d2:84, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== connect_volume: return (2195ms) {'type': 'block', 'scsi_wwn': '23161383565386131', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161383565386131', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNFgKilW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:22 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:22 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:22 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163ee31-af5b-4fe3-97c3-db1d4d3ba8bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:22 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f00fc6-6cb0-41a6-a55e-dcf2bb3b72b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68] added
Oct 20 14:33:22 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa36e3e-d03f-4886-aefa-c6f0b53e44e5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c00bd-d627-46e9-ba39-f18038e7457b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNFgKilW {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNFgKilW" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46074954-8267-4544-ae2e-9ef9e70edff5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNFgKilW'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d7661-6563-4bd1-b2e9-e855e140fc35]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c68f8eb-ba79-476f-8162-c12f19ac1814]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b315ddbf-7d2e-414e-bb63-3f0fb1d862d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260]
Oct 20 14:33:22 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:22 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcad4db-5ea4-4726-bd15-ddf7f3fd317b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5572467e-d3fd-410f-827c-15fe71519fb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:22 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d77df3-0886-4517-a56a-41a3fab0c63c]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNFgKilW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26533383738623163', 'path': '/dev/sde'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533383738623163', 'path': '/dev/sde'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAvlWFTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:23 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:23 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:23 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ae3ae-f498-4bc0-8535-e9d8527e1097]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:23 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a47a19-54a9-4b66-9fc3-dad566247f07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5] added
Oct 20 14:33:23 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2274b58-afe3-4777-82e8-42680fc2c047]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a4b68-a764-44af-a8a4-4f3b4dd4d54a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAvlWFTi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CAvlWFTi" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[958908db-f3b5-407c-bfeb-26ac3114cc71]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CAvlWFTi'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee583d-8c77-46ca-9f8b-399ebb9bcaaf]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1d214-4b6d-44b7-aa9d-04548cae2ceb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c24f2-399c-4cc1-b5e4-66745c406b1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260]
Oct 20 14:33:23 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:23 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c190aa6e-610a-4bfe-96b2-b89c5bc30210]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee106b6d-e3cb-406e-8953-594b15cccd2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:23 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[332b0d60-33cc-47f6-9e52-c6c39bcf1336]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:23 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAvlWFTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26435323961666666', 'path': '/dev/sdf'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323961666666', 'path': '/dev/sdf'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.objects.instance [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lazy-loading 'pci_devices' on Instance uuid 122e112c-ed24-4206-bbc0-2e9c0feca923 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:33:25 user nova-compute[76870]:   <uuid>122e112c-ed24-4206-bbc0-2e9c0feca923</uuid>
Oct 20 14:33:25 user nova-compute[76870]:   <name>instance-00000009</name>
Oct 20 14:33:25 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:33:25 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:33:25 user nova-compute[76870]:   <metadata>
Oct 20 14:33:25 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:33:25 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:33:25 user nova-compute[76870]:       <nova:name>tempest-device-tagging-server-985980830</nova:name>
Oct 20 14:33:25 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:33:19</nova:creationTime>
Oct 20 14:33:25 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:33:25 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:33:25 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:33:25 user nova-compute[76870]:       <nova:owner>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:user uuid="d054f71a7f134e5e9c8989fda21ff6bd">tempest-TaggedBootDevicesTest_v242-413614803-project-member</nova:user>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:project uuid="026fac370fef4694a8f7783536f16d14">tempest-TaggedBootDevicesTest_v242-413614803</nova:project>
Oct 20 14:33:25 user nova-compute[76870]:       </nova:owner>
Oct 20 14:33:25 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:33:25 user nova-compute[76870]:       <nova:ports>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="da0116b9-289d-49cd-838e-ca41dd4fc65c">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="9dc70403-ae2b-4e23-9994-acb5e04ba8a9">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="32a4ac34-1e52-400d-884e-536bb1640f0e">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="2ee65f9a-2440-4423-b4a1-cbd24656d6be">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="ece05121-0eef-4d74-b9e9-c9e95c71fb61">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.26" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="6a3e9c7b-9789-4d8b-a41f-1189add63dce">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:         <nova:port uuid="b9165885-92ad-4c7c-aa4f-574594dd2913">
Oct 20 14:33:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 14:33:25 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:25 user nova-compute[76870]:       </nova:ports>
Oct 20 14:33:25 user nova-compute[76870]:     </nova:instance>
Oct 20 14:33:25 user nova-compute[76870]:   </metadata>
Oct 20 14:33:25 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:33:25 user nova-compute[76870]:     <system>
Oct 20 14:33:25 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:33:25 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:33:25 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:33:25 user nova-compute[76870]:       <entry name="serial">122e112c-ed24-4206-bbc0-2e9c0feca923</entry>
Oct 20 14:33:25 user nova-compute[76870]:       <entry name="uuid">122e112c-ed24-4206-bbc0-2e9c0feca923</entry>
Oct 20 14:33:25 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:33:25 user nova-compute[76870]:     </system>
Oct 20 14:33:25 user nova-compute[76870]:   </sysinfo>
Oct 20 14:33:25 user nova-compute[76870]:   <os>
Oct 20 14:33:25 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:33:25 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:33:25 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:33:25 user nova-compute[76870]:   </os>
Oct 20 14:33:25 user nova-compute[76870]:   <features>
Oct 20 14:33:25 user nova-compute[76870]:     <acpi/>
Oct 20 14:33:25 user nova-compute[76870]:     <apic/>
Oct 20 14:33:25 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:33:25 user nova-compute[76870]:   </features>
Oct 20 14:33:25 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:33:25 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:33:25 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:33:25 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:33:25 user nova-compute[76870]:   </clock>
Oct 20 14:33:25 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:33:25 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:33:25 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:33:25 user nova-compute[76870]:   </cpu>
Oct 20 14:33:25 user nova-compute[76870]:   <devices>
Oct 20 14:33:25 user nova-compute[76870]:     <disk type="file" device="cdrom">
Oct 20 14:33:25 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 14:33:25 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923/disk.config"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="hda" bus="ide"/>
Oct 20 14:33:25 user nova-compute[76870]:     </disk>
Oct 20 14:33:25 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:33:25 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:25 user nova-compute[76870]:       <source dev="/dev/sdd"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <serial>92d77c6b-4c27-4457-8504-72a0269428a0</serial>
Oct 20 14:33:25 user nova-compute[76870]:     </disk>
Oct 20 14:33:25 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:33:25 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:25 user nova-compute[76870]:       <source dev="/dev/sde"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <serial>5049d394-b020-4e03-9319-5bb8c46ada68</serial>
Oct 20 14:33:25 user nova-compute[76870]:     </disk>
Oct 20 14:33:25 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:33:25 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:25 user nova-compute[76870]:       <source dev="/dev/sdf"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="vdc" bus="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <serial>4d616ccc-29a7-4c36-bb20-ee3ee32b93d5</serial>
Oct 20 14:33:25 user nova-compute[76870]:     </disk>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:55:2d:54"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tapda0116b9-28"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:49:d7:60"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tap9dc70403-ae"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:45:ed:fd"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tap32a4ac34-1e"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:2e:7c:28"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tap2ee65f9a-24"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:79:cf:91"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tapece05121-0e"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:8e:1d:9e"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tap6a3e9c7b-97"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:25 user nova-compute[76870]:       <mac address="fa:16:3e:c3:43:ce"/>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:25 user nova-compute[76870]:       <target dev="tapb9165885-92"/>
Oct 20 14:33:25 user nova-compute[76870]:     </interface>
Oct 20 14:33:25 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:33:25 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923/console.log" append="off"/>
Oct 20 14:33:25 user nova-compute[76870]:     </serial>
Oct 20 14:33:25 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:33:25 user nova-compute[76870]:     <video>
Oct 20 14:33:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:25 user nova-compute[76870]:     </video>
Oct 20 14:33:25 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:33:25 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:33:25 user nova-compute[76870]:     </rng>
Oct 20 14:33:25 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:33:25 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:33:25 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:33:25 user nova-compute[76870]:     </memballoon>
Oct 20 14:33:25 user nova-compute[76870]:   </devices>
Oct 20 14:33:25 user nova-compute[76870]: </domain>
Oct 20 14:33:25 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2f094f5-7c7e-5a86-a730-f7ffba3ffb34', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda0116b9-28, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda0116b9-28, col_values=(('qos', UUID('a3cae223-d665-4648-8609-35e6f8bba4ec')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda0116b9-28, col_values=(('external_ids', {'iface-id': 'da0116b9-289d-49cd-838e-ca41dd4fc65c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:2d:54', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb5283bd-3bb3-5289-b1c0-0bae232126d9', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dc70403-ae, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dc70403-ae, col_values=(('qos', UUID('62f2a276-ba0c-4191-a187-d93e08d17a19')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dc70403-ae, col_values=(('external_ids', {'iface-id': '9dc70403-ae2b-4e23-9994-acb5e04ba8a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:d7:60', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04344905-2b2d-5582-9496-22e523b3ca0a', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32a4ac34-1e, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32a4ac34-1e, col_values=(('qos', UUID('d110c217-2be6-4d45-b35d-0fb5c190b99d')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32a4ac34-1e, col_values=(('external_ids', {'iface-id': '32a4ac34-1e52-400d-884e-536bb1640f0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:ed:fd', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a98f706-e95f-523b-a1b7-e7dc0f361f8b', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee65f9a-24, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ee65f9a-24, col_values=(('qos', UUID('b2e6c82d-36fe-41c4-a920-b5f5b85893e7')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ee65f9a-24, col_values=(('external_ids', {'iface-id': '2ee65f9a-2440-4423-b4a1-cbd24656d6be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:7c:28', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '248374dd-cd32-509a-a5ef-5bf8dc5365ba', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapece05121-0e, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapece05121-0e, col_values=(('qos', UUID('9c92e210-2c41-409e-93b0-49b4acec154a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapece05121-0e, col_values=(('external_ids', {'iface-id': 'ece05121-0eef-4d74-b9e9-c9e95c71fb61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:cf:91', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ed817c4-333f-588f-b77f-26e5c0186104', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a3e9c7b-97, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a3e9c7b-97, col_values=(('qos', UUID('8b05bcee-b6f8-4b9d-9847-53339085f521')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a3e9c7b-97, col_values=(('external_ids', {'iface-id': '6a3e9c7b-9789-4d8b-a41f-1189add63dce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:1d:9e', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e811da8a-0cd5-5368-ab74-9ebad304487d', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9165885-92, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9165885-92, col_values=(('qos', UUID('f584d007-f027-41cc-acee-e8019f5cfd73')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9165885-92, col_values=(('external_ids', {'iface-id': 'b9165885-92ad-4c7c-aa4f-574594dd2913', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:43:ce', 'vm-uuid': '122e112c-ed24-4206-bbc0-2e9c0feca923'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:25 user nova-compute[76870]: INFO os_vif [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92')
Oct 20 14:33:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] No BDM found with device name hda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] No VIF found with MAC fa:16:3e:55:2d:54, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] No VIF found with MAC fa:16:3e:79:cf:91, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Using config drive
Oct 20 14:33:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:33:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:33:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Creating config drive at /opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923/disk.config
Oct 20 14:33:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt_qv7uen {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt_qv7uen" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruXOlshc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:26 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:26 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:26 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c4a05f-607f-4ad0-a741-2de1aa3065cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:26 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[293465aa-8127-4cfa-a975-d8e47b99af4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4] added
Oct 20 14:33:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0058c6-70ba-4ccf-a634-de523d0b41b3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a765ce-82c9-47b5-952b-bab115d4ae95]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruXOlshc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruXOlshc" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bcb009-ddaa-4722-af1b-72b0ec548878]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruXOlshc'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c279e2-7019-4c9e-aef3-b268ced9cf1b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5b13e6-591e-4c0b-a87b-8d876c45b633]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c882d316-34bf-4729-8e1b-0ef36ac0de60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260]
Oct 20 14:33:26 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[13381edd-c22e-4ccd-b1a4-a4af3f7bb238]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a1597b1e-f626-42c3-9ba6-4b1ca1f1f626 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.252s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7653b65f-18bd-4c66-ba1b-9f0beafc697c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f60b33-bef3-416e-a7c0-531964dae661]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruXOlshc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-6afae21a-443f-4a8a-9125-d6b2c61f33db req-f9d8477c-b0e1-4bdf-9019-4eb2d0d01f23 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6afae21a-443f-4a8a-9125-d6b2c61f33db req-f9d8477c-b0e1-4bdf-9019-4eb2d0d01f23 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6afae21a-443f-4a8a-9125-d6b2c61f33db req-f9d8477c-b0e1-4bdf-9019-4eb2d0d01f23 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6afae21a-443f-4a8a-9125-d6b2c61f33db req-f9d8477c-b0e1-4bdf-9019-4eb2d0d01f23 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-6afae21a-443f-4a8a-9125-d6b2c61f33db req-f9d8477c-b0e1-4bdf-9019-4eb2d0d01f23 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:27 user nova-compute[76870]: WARNING nova.compute.manager [req-6afae21a-443f-4a8a-9125-d6b2c61f33db req-f9d8477c-b0e1-4bdf-9019-4eb2d0d01f23 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c for instance with vm_state building and task_state spawning.
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23238316632396533', 'path': '/dev/sdg'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238316632396533', 'path': '/dev/sdg'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lazy-loading 'flavor' on Instance uuid cc506fab-01ee-4944-b09f-f97fd0c21c77 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:33:27 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:27 user nova-compute[76870]:   <source dev="/dev/sdg"/>
Oct 20 14:33:27 user nova-compute[76870]:   <target dev="sdc" bus="scsi"/>
Oct 20 14:33:27 user nova-compute[76870]:   <serial>dab79a92-c729-441d-af33-286489ef36b4</serial>
Oct 20 14:33:27 user nova-compute[76870]:   <address type="drive" controller="0" unit="2"/>
Oct 20 14:33:27 user nova-compute[76870]: </disk>
Oct 20 14:33:27 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d27f8f9-f3ca-4139-ba7f-2faabb2cbb8a req-8348b5c6-3dbc-4d32-9051-81ce4b5c7111 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d27f8f9-f3ca-4139-ba7f-2faabb2cbb8a req-8348b5c6-3dbc-4d32-9051-81ce4b5c7111 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d27f8f9-f3ca-4139-ba7f-2faabb2cbb8a req-8348b5c6-3dbc-4d32-9051-81ce4b5c7111 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d27f8f9-f3ca-4139-ba7f-2faabb2cbb8a req-8348b5c6-3dbc-4d32-9051-81ce4b5c7111 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d27f8f9-f3ca-4139-ba7f-2faabb2cbb8a req-8348b5c6-3dbc-4d32-9051-81ce4b5c7111 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:28 user nova-compute[76870]: WARNING nova.compute.manager [req-0d27f8f9-f3ca-4139-ba7f-2faabb2cbb8a req-8348b5c6-3dbc-4d32-9051-81ce4b5c7111 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 for instance with vm_state building and task_state spawning.
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No BDM found with device name sda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No BDM found with device name sdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] No VIF found with MAC fa:16:3e:f8:ff:9a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG os_brick.utils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b20bbcf5-c69e-4f6a-a02a-c9b10aaeb51a tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.011s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[813aaee7-d60f-445b-81b8-4509af101691]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d2b4c3-dfe8-4182-9304-1c71f1a25040]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2035241d-c999-465c-afae-06e6e86fe962]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[630127cb-a876-47cc-a334-36b9c53dc6bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:33:28 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:33:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f36b4-1e7f-40a4-a706-dd6efcc7f2bf]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:33:28 user nova-compute[76870]: DEBUG os_brick.utils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: INFO nova.compute.manager [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Swapping volume 09597554-9085-4f07-b262-2256a027aac8 for 1765872c-e17a-4f04-a348-26be3dc21b54
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:29 user nova-compute[76870]: WARNING nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c for instance with vm_state building and task_state spawning.
Oct 20 14:33:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:29 user nova-compute[76870]: WARNING nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be for instance with vm_state building and task_state spawning.
Oct 20 14:33:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:29 user nova-compute[76870]: WARNING nova.compute.manager [req-faed869a-e1d7-4a5c-a02d-0e7266269c1f req-820bfa88-e0d7-402c-b529-33e9df7171e7 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be for instance with vm_state building and task_state spawning.
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:30 user nova-compute[76870]: WARNING nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 for instance with vm_state building and task_state spawning.
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:30 user nova-compute[76870]: WARNING nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e for instance with vm_state building and task_state spawning.
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:30 user nova-compute[76870]: WARNING nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e for instance with vm_state building and task_state spawning.
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:30 user nova-compute[76870]: WARNING nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 for instance with vm_state building and task_state spawning.
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:30 user nova-compute[76870]: WARNING nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 for instance with vm_state building and task_state spawning.
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:30 user nova-compute[76870]: WARNING nova.compute.manager [req-06783c0e-9b9f-48fe-9623-57cba1d41a85 req-800cad80-f136-4862-bec2-75a7c8e1314d service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce for instance with vm_state building and task_state spawning.
Oct 20 14:33:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdg (sdc) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance spawned successfully.
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:32 user nova-compute[76870]: WARNING nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce for instance with vm_state building and task_state spawning.
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:32 user nova-compute[76870]: WARNING nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 for instance with vm_state building and task_state spawning.
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:32 user nova-compute[76870]: WARNING nova.compute.manager [req-df72b546-031c-47ce-91f1-133d048a15e3 req-c615d945-a436-4770-993c-869425e7045f service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 for instance with vm_state building and task_state spawning.
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:32 user nova-compute[76870]: INFO nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Took 12.40 seconds to spawn the instance on the hypervisor.
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:32 user nova-compute[76870]: INFO nova.compute.manager [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Took 73.25 seconds to build instance.
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.444s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5beff369-2004-4afb-a91e-9ebc0d5b8052 tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 73.387s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:33:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=25.575267791748047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a734d0c6-9dff-4254-9231-040de2c5eacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance cc506fab-01ee-4944-b09f-f97fd0c21c77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 62254105-7623-4f3c-923b-f3cb7d304044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 122e112c-ed24-4206-bbc0-2e9c0feca923 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:33:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:33:34 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:33:34 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:33:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:33:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:33:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-changed-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Refreshing instance network info cache due to event network-changed-bcfb2365-84e9-4fbb-9d41-cb6901931b1c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] Acquiring lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] Acquired lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Refreshing network info cache for port bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updated VIF entry in instance network info cache for port bcfb2365-84e9-4fbb-9d41-cb6901931b1c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updating instance_info_cache with network_info: [{"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:33:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-44ce6214-0a8a-4d9b-b6c4-d05e33846397 req-01c0c570-175a-4577-a236-78cda9df79ea service nova] Releasing lock "refresh_cache-92d2469d-6ab3-446e-be34-6a657448fc25" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOqmSZfX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:40 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:40 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:40 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f230159f-259e-4322-b1ce-b1ec54727cd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:40 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9467e79e-13b8-487b-b127-981de1a6ccae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a] added
Oct 20 14:33:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f764d82b-7992-433b-9495-522bf71f6ec1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02551ca4-53dd-4233-a50f-74291768591d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOqmSZfX {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOqmSZfX" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93dce5-3b1c-458c-8bc2-9dd09cf46510]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KOqmSZfX'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bed6da-28b1-4cd3-8177-d983cafbf285]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7900583d-0370-4bc0-ac15-17430656b366]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6f8459-54e1-4b8a-8ea0-b227d09a56e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260]
Oct 20 14:33:41 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:41 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2418ad-537c-48a7-bcfc-7a4172ae7d8e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707985d-f6ea-40a1-84ea-d6a310bf9fd8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:41 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:41 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:41 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8f9209-a1bd-4931-9894-8ebce15878fd]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOqmSZfX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:41 user nova-compute[76870]: INFO nova.compute.manager [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Detaching volume dab79a92-c729-441d-af33-286489ef36b4
Oct 20 14:33:41 user nova-compute[76870]: INFO nova.virt.block_device [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Attempting to driver detach volume dab79a92-c729-441d-af33-286489ef36b4 from mountpoint /dev/sdc
Oct 20 14:33:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Attempting to detach device sdc from instance cc506fab-01ee-4944-b09f-f97fd0c21c77 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:33:41 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:41 user nova-compute[76870]:   <source dev="/dev/sdg"/>
Oct 20 14:33:41 user nova-compute[76870]:   <target dev="sdc" bus="scsi"/>
Oct 20 14:33:41 user nova-compute[76870]:   <serial>dab79a92-c729-441d-af33-286489ef36b4</serial>
Oct 20 14:33:41 user nova-compute[76870]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 14:33:41 user nova-compute[76870]: </disk>
Oct 20 14:33:41 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:33:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Successfully detached device sdc from instance cc506fab-01ee-4944-b09f-f97fd0c21c77 from the persistent domain config.
Oct 20 14:33:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance cc506fab-01ee-4944-b09f-f97fd0c21c77 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:33:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:33:41 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:41 user nova-compute[76870]:   <source dev="/dev/sdg"/>
Oct 20 14:33:41 user nova-compute[76870]:   <target dev="sdc" bus="scsi"/>
Oct 20 14:33:41 user nova-compute[76870]:   <serial>dab79a92-c729-441d-af33-286489ef36b4</serial>
Oct 20 14:33:41 user nova-compute[76870]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 14:33:41 user nova-compute[76870]: </disk>
Oct 20 14:33:41 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:33:42 user nova-compute[76870]: INFO nova.compute.manager [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Rebuilding instance
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance cc506fab-01ee-4944-b09f-f97fd0c21c77 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23233356439313938', 'path': '/dev/sdh'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233356439313938', 'path': '/dev/sdh'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:33:42 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Creating image(s)
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Ensure instance console log exists: /opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Start _get_guest_xml network_info=[{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '24792ed0-5054-4862-9482-3e387ae17c11', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'madfTuqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6232a67-b577-44c6-b385-fd18db4d0984', 'serial': 'a6232a67-b577-44c6-b385-fd18db4d0984'}, 'volume_type': None}, {'attachment_id': '1e3c1124-9e35-4659-8586-ebbd6b9f073e', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOtfcIyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36', 'attached_at': '', 'detached_at': '', 'volume_id': '6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd', 'serial': '6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd'}, 'volume_type': None}, {'attachment_id': '17b32573-1b77-420f-8c06-3bc7e1b7471c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuHUvDBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36', 'attached_at': '', 'detached_at': '', 'volume_id': '741b4dcc-b82e-4af7-9601-d21d82356fbf', 'serial': '741b4dcc-b82e-4af7-9601-d21d82356fbf'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.objects.instance [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lazy-loading 'flavor' on Instance uuid 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:42 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:33:42 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'madfTuqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:42 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:42 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:42 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 14:33:42 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:42 user nova-compute[76870]:   <source dev="/dev/sdh"/>
Oct 20 14:33:42 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:33:42 user nova-compute[76870]:   <serial>653fde4c-7895-425f-beae-2daf9caee86a</serial>
Oct 20 14:33:42 user nova-compute[76870]: </disk>
Oct 20 14:33:42 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a9625-4449-4263-b8d4-6f4ceb817cf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:42 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d4739-117c-4659-86c7-805a1643d890]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984] added
Oct 20 14:33:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8bc0ab-7725-4b71-a2f9-5b276f1981d6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73b2002-bcf8-4d96-828a-7fdc4c238dc5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v madfTuqB {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v madfTuqB" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bb4841-e3a3-4320-b228-9c8670e2b804]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'madfTuqB'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b42caa4-78fc-458c-8148-11ab75e11721]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-6c43826d-eed4-4d83-9a67-699c72bddf84 req-aa150217-78b2-4a73-859c-b7fced4896c6 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-vif-unplugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6c43826d-eed4-4d83-9a67-699c72bddf84 req-aa150217-78b2-4a73-859c-b7fced4896c6 service nova] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6c43826d-eed4-4d83-9a67-699c72bddf84 req-aa150217-78b2-4a73-859c-b7fced4896c6 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6c43826d-eed4-4d83-9a67-699c72bddf84 req-aa150217-78b2-4a73-859c-b7fced4896c6 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-6c43826d-eed4-4d83-9a67-699c72bddf84 req-aa150217-78b2-4a73-859c-b7fced4896c6 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] No waiting events found dispatching network-vif-unplugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:42 user nova-compute[76870]: WARNING nova.compute.manager [req-6c43826d-eed4-4d83-9a67-699c72bddf84 req-aa150217-78b2-4a73-859c-b7fced4896c6 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received unexpected event network-vif-unplugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c for instance with vm_state active and task_state rebuilding.
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c988cd-34a0-440b-8e1f-d807e41e0596]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[254d5d2d-38b3-4e14-9029-30ffe19784b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260]
Oct 20 14:33:42 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d57bf4-9f09-42a5-9955-045af7e8548c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e8b2f-efc4-4873-a551-735a7457f78d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:42 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fae7cbd-1de0-4708-85c3-62f5e50ee398]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'madfTuqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] No VIF found with MAC fa:16:3e:f5:28:f9, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d9d67aa7-857c-4927-9cae-d8faad3ef073 tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "62254105-7623-4f3c-923b-f3cb7d304044" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.351s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance destroyed successfully.
Oct 20 14:33:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance destroyed successfully.
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-642203174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-825684685',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8PQcQNpcaMeuR3Tbq+ugMSrAL3pjWKxDw6zJHwmogZCJUZKwHNcGeLNciZdqccQ89uBsi4Zws2NoA9QS07uGH0kSxae1Btu3OThNA10ueYWROzhSVNn77/jEFKFYkJRw==',key_name='tempest-keypair-1411999794',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='122b62cc9ab847fe847375a3b2150b43',ramdisk_id='',reservation_id='r-nt9wz1ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-279014424',owner_user_name='tempest-ServerActionsV293TestJSON-279014424-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:33:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23df1790ab3d48c4b5b52c11b9b5bb30',uuid=92d2469d-6ab3-446e-be34-6a657448fc25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converting VIF {"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_vif [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcfb2365-84, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63ef9ed2-9122-49a1-bf81-f18ce4b520b4) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:43 user nova-compute[76870]: INFO os_vif [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84')
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNUOJRPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:43 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] volume_snapshot_create: create_info: {'snapshot_id': '557cda04-f0b1-4cfa-a73b-d45d12ee07de', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=76870) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] snap xml: <domainsnapshot>
Oct 20 14:33:43 user nova-compute[76870]:   <disks>
Oct 20 14:33:43 user nova-compute[76870]:     <disk name="/dev/sdh" snapshot="external" type="file">
Oct 20 14:33:43 user nova-compute[76870]:       <source file="/dev/new_file"/>
Oct 20 14:33:43 user nova-compute[76870]:     </disk>
Oct 20 14:33:43 user nova-compute[76870]:     <disk name="vda" snapshot="no"/>
Oct 20 14:33:43 user nova-compute[76870]:   </disks>
Oct 20 14:33:43 user nova-compute[76870]: </domainsnapshot>
Oct 20 14:33:43 user nova-compute[76870]:  {{(pid=76870) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] Lazy-loading 'system_metadata' on Instance uuid 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     rv = execute(f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     six.reraise(c, e, tb)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     raise value
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     rv = meth(*args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     self._volume_snapshot_create(context, instance, guest,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     rv = execute(f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     six.reraise(c, e, tb)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     raise value
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     rv = meth(*args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] 
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2d10cdd3-2b31-467d-b1d3-cf1fc2f11886 tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] volume_snapshot_delete: delete_info: {'volume_id': '653fde4c-7895-425f-beae-2daf9caee86a'} {{(pid=76870) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [None req-2d10cdd3-2b31-467d-b1d3-cf1fc2f11886 tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044]     if delete_info['type'] != 'qcow2':
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] KeyError: 'type'
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [instance: 62254105-7623-4f3c-923b-f3cb7d304044] 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 557cda04-f0b1-4cfa-a73b-d45d12ee07de could not be found.
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 557cda04-f0b1-4cfa-a73b-d45d12ee07de could not be found. (HTTP 404) (Request-ID: req-80ac6074-934b-4354-a2c8-609b739106cf)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 557cda04-f0b1-4cfa-a73b-d45d12ee07de could not be found.
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-4877e7be-b2a5-4c78-8e16-e77488a6a7ef tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver [None req-2d10cdd3-2b31-467d-b1d3-cf1fc2f11886 tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6101fc13-5309-46ad-9186-7bc931c7e5fe)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 14:33:43 user nova-compute[76870]: ERROR nova.virt.libvirt.driver 
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-2d10cdd3-2b31-467d-b1d3-cf1fc2f11886 tempest-VolumesAssistedSnapshotsTest-992173540 tempest-VolumesAssistedSnapshotsTest-992173540-project] Exception during message handling: KeyError: 'type'
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 14:33:43 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23138303566613431', 'path': '/dev/sdi'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138303566613431', 'path': '/dev/sdi'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.497s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOtfcIyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:43 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6082ab-c237-4442-af23-41d79b9c05e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:33:43 user nova-compute[76870]: No targets found.
Oct 20 14:33:43 user nova-compute[76870]: iSNS:
Oct 20 14:33:43 user nova-compute[76870]: No targets found.
Oct 20 14:33:43 user nova-compute[76870]: STATIC:
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:33:43 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:43 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:43 user nova-compute[76870]: FIRMWARE:
Oct 20 14:33:43 user nova-compute[76870]: No targets found.
Oct 20 14:33:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:33:43 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:33:43 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4cff5-3948-4358-aed4-20e84b328f05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c615794-5393-423c-b66b-eb063314461f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:43 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8716830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:33:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cffa94-a7e2-4367-acb1-04570860848f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2811b64-8131-4cfe-8575-772f47419205]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "62254105-7623-4f3c-923b-f3cb7d304044" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b54fb-8f12-4f73-b4e5-e81bf1b23707]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: INFO nova.compute.manager [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Detaching volume 653fde4c-7895-425f-beae-2daf9caee86a
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[807f29a4-4924-4582-ab34-be68862a9777]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: INFO nova.virt.block_device [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Attempting to driver detach volume 653fde4c-7895-425f-beae-2daf9caee86a from mountpoint /dev/vdb
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc42b4e-8b5e-43ba-915b-ffd4630bd7e2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Attempting to detach device vdb from instance 62254105-7623-4f3c-923b-f3cb7d304044 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 14:33:44 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:44 user nova-compute[76870]:   <source dev="/dev/sdh"/>
Oct 20 14:33:44 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:33:44 user nova-compute[76870]:   <serial>653fde4c-7895-425f-beae-2daf9caee86a</serial>
Oct 20 14:33:44 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:33:44 user nova-compute[76870]: </disk>
Oct 20 14:33:44 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:33:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Successfully detached device vdb from instance 62254105-7623-4f3c-923b-f3cb7d304044 from the persistent domain config.
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62254105-7623-4f3c-923b-f3cb7d304044 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 14:33:44 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:44 user nova-compute[76870]:   <source dev="/dev/sdh"/>
Oct 20 14:33:44 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:33:44 user nova-compute[76870]:   <serial>653fde4c-7895-425f-beae-2daf9caee86a</serial>
Oct 20 14:33:44 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:33:44 user nova-compute[76870]: </disk>
Oct 20 14:33:44 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc7402-b19b-484d-b151-da83aa9bf9c3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260]
Oct 20 14:33:44 user nova-compute[76870]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[517b5d0a-a118-4396-85fd-a911adbc3432]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] <== disconnect_volume: return (856ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:33:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Deleting instance files /opt/stack/data/nova/instances/92d2469d-6ab3-446e-be34-6a657448fc25_del
Oct 20 14:33:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Deletion of /opt/stack/data/nova/instances/92d2469d-6ab3-446e-be34-6a657448fc25_del complete
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.334s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:44 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:44 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260" returned: 21 in 0.096s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eaaf5d-830c-448e-8ba9-7c6936891ea0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:44 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[128be14f-2bee-471a-902d-84d8fc639db8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd] added
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e297ad2-1932-4b0a-b18a-890fe85c811d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764bd0d-db03-4cf4-b359-2d97f3b57d97]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uOtfcIyl {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uOtfcIyl" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[820562a2-10f2-4b1e-bfb6-f94cd59e4a24]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uOtfcIyl'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7427d5-754b-449e-b956-894a7534b598]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c8c54-755a-4391-bceb-ba5b1d11ec1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 92d2469d-6ab3-446e-be34-6a657448fc25 could not be found.
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNUOJRPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:44 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee18f83-d316-42d2-91f7-de47cda1680c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260]
Oct 20 14:33:44 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2be116-2139-487b-a408-323a20edd104]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d874035d-a577-4b08-991d-71d922e8697b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:44 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-ffe7cef7-d436-46ea-ae2c-571061eb9f51 req-951ef007-ba09-4a0e-8496-f0c57586acf3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffe7cef7-d436-46ea-ae2c-571061eb9f51 req-951ef007-ba09-4a0e-8496-f0c57586acf3 service nova] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffe7cef7-d436-46ea-ae2c-571061eb9f51 req-951ef007-ba09-4a0e-8496-f0c57586acf3 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffe7cef7-d436-46ea-ae2c-571061eb9f51 req-951ef007-ba09-4a0e-8496-f0c57586acf3 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-ffe7cef7-d436-46ea-ae2c-571061eb9f51 req-951ef007-ba09-4a0e-8496-f0c57586acf3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] No waiting events found dispatching network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:44 user nova-compute[76870]: WARNING nova.compute.manager [req-ffe7cef7-d436-46ea-ae2c-571061eb9f51 req-951ef007-ba09-4a0e-8496-f0c57586acf3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received unexpected event network-vif-plugged-bcfb2365-84e9-4fbb-9d41-cb6901931b1c for instance with vm_state active and task_state rebuilding.
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f11a1-c305-4afc-b8b2-921e9f7d188f]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOtfcIyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== connect_volume: return (1798ms) {'type': 'block', 'scsi_wwn': '23230636333303265', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230636333303265', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.182s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuHUvDBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:33:45 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acab188-a30f-4bd3-b7ea-b5fc16e5cc26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:33:45 user nova-compute[76870]: No targets found.
Oct 20 14:33:45 user nova-compute[76870]: iSNS:
Oct 20 14:33:45 user nova-compute[76870]: No targets found.
Oct 20 14:33:45 user nova-compute[76870]: STATIC:
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:33:45 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:33:45 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:33:45 user nova-compute[76870]: FIRMWARE:
Oct 20 14:33:45 user nova-compute[76870]: No targets found.
Oct 20 14:33:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:33:45 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:33:45 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9537c5b-8f44-4148-91a0-44dbb71f5d30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40df2b83-8aa4-495b-b818-36bbb6153045]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:45 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c4d7ac0>, {}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Disconnecting from: [] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] <== disconnect_volume: return (1278ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.072s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:45 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:33:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:33:45 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:33:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e546aa5-595b-486a-ba1d-9135f791e43a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:33:46 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd53221-0019-4ac3-b41d-555ad9e50846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf] added
Oct 20 14:33:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7b48c3-14cb-4d6f-af1f-2c0b975c3e54]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ac33c-3816-4871-8195-ebf9a80e8acb]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuHUvDBf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuHUvDBf" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc863a-6b5c-474c-b2de-b04513a9ae5d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuHUvDBf'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[372817f8-c286-41e5-b74d-7c14a3c90b76]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d34c5f-5be3-4e0a-89a7-d1b50dc32a2b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70fa8f5-9dbb-46aa-b2c5-8cb7e94e8201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260]
Oct 20 14:33:46 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260] successful.
Oct 20 14:33:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8519c0-d535-4e32-b780-78be24c5cf39]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87642750-9da2-49c5-9eb3-eb5da3626113]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:33:46 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:33:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.550s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1855951e-60aa-48c3-b7e7-7e1d1f865545]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:33:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuHUvDBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.compute.manager [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Preparing to wait for external event volume-reimaged-85145293-1072-4fa3-bfd2-91ed71a8cc83 {{(pid=76870) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.volume.cinder [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] Update attachment failed for attachment 4355a242-94e5-4820-bccd-4ce8940873f2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4117f8b5-d40d-456e-835e-bd8941a7f296) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4117f8b5-d40d-456e-835e-bd8941a7f296)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Failed to connect to volume 1765872c-e17a-4f04-a348-26be3dc21b54 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4117f8b5-d40d-456e-835e-bd8941a7f296)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Traceback (most recent call last):
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     new_cinfo = self.volume_api.attachment_update(
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     res = method(self, ctx, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     with excutils.save_and_reraise_exception():
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     self.force_reraise()
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     raise self.value
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     return method.func(obj, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     return self.request(url, method, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d]     raise exceptions.from_response(resp, body)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4117f8b5-d40d-456e-835e-bd8941a7f296)
Oct 20 14:33:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] 
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.593s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== connect_volume: return (1666ms) {'type': 'block', 'scsi_wwn': '23031376230306532', 'path': '/dev/sdj'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031376230306532', 'path': '/dev/sdj'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.734s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lazy-loading 'pci_devices' on Instance uuid 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:33:47 user nova-compute[76870]:   <uuid>44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36</uuid>
Oct 20 14:33:47 user nova-compute[76870]:   <name>instance-0000000a</name>
Oct 20 14:33:47 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:33:47 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:33:47 user nova-compute[76870]:   <metadata>
Oct 20 14:33:47 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:33:47 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:33:47 user nova-compute[76870]:       <nova:name>tempest-device-tagging-server-391900128</nova:name>
Oct 20 14:33:47 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:33:42</nova:creationTime>
Oct 20 14:33:47 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:33:47 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:33:47 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:33:47 user nova-compute[76870]:       <nova:owner>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:user uuid="ef3ed46cbe0a41e48a560c18c8733f40">tempest-TaggedBootDevicesTest-1650508878-project-member</nova:user>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:project uuid="c7ae9c6a9c114b5b811c6f6c77aac86e">tempest-TaggedBootDevicesTest-1650508878</nova:project>
Oct 20 14:33:47 user nova-compute[76870]:       </nova:owner>
Oct 20 14:33:47 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:33:47 user nova-compute[76870]:       <nova:ports>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="44c4be28-1456-4293-b59e-dc6ecf5d2bf2">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="e0a3fe71-4e0f-4cd7-80e7-5191c9397469">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="1bb94220-5586-400e-844c-6a83087ce4f1">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="990044fc-5a03-4382-8c07-403709389e6e">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="d78f5177-7d40-4ce0-ac07-63126fa6d312">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:         <nova:port uuid="eefb9952-705b-4911-b643-7f7ddbcbc0b7">
Oct 20 14:33:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 14:33:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:33:47 user nova-compute[76870]:       </nova:ports>
Oct 20 14:33:47 user nova-compute[76870]:     </nova:instance>
Oct 20 14:33:47 user nova-compute[76870]:   </metadata>
Oct 20 14:33:47 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:33:47 user nova-compute[76870]:     <system>
Oct 20 14:33:47 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:33:47 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:33:47 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:33:47 user nova-compute[76870]:       <entry name="serial">44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36</entry>
Oct 20 14:33:47 user nova-compute[76870]:       <entry name="uuid">44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36</entry>
Oct 20 14:33:47 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:33:47 user nova-compute[76870]:     </system>
Oct 20 14:33:47 user nova-compute[76870]:   </sysinfo>
Oct 20 14:33:47 user nova-compute[76870]:   <os>
Oct 20 14:33:47 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:33:47 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:33:47 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:33:47 user nova-compute[76870]:   </os>
Oct 20 14:33:47 user nova-compute[76870]:   <features>
Oct 20 14:33:47 user nova-compute[76870]:     <acpi/>
Oct 20 14:33:47 user nova-compute[76870]:     <apic/>
Oct 20 14:33:47 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:33:47 user nova-compute[76870]:   </features>
Oct 20 14:33:47 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:33:47 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:33:47 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:33:47 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:33:47 user nova-compute[76870]:   </clock>
Oct 20 14:33:47 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:33:47 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:33:47 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:33:47 user nova-compute[76870]:   </cpu>
Oct 20 14:33:47 user nova-compute[76870]:   <devices>
Oct 20 14:33:47 user nova-compute[76870]:     <disk type="file" device="cdrom">
Oct 20 14:33:47 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 14:33:47 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36/disk.config"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="hda" bus="ide"/>
Oct 20 14:33:47 user nova-compute[76870]:     </disk>
Oct 20 14:33:47 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:33:47 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:47 user nova-compute[76870]:       <source dev="/dev/sdi"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <serial>a6232a67-b577-44c6-b385-fd18db4d0984</serial>
Oct 20 14:33:47 user nova-compute[76870]:     </disk>
Oct 20 14:33:47 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:33:47 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:47 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <serial>6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd</serial>
Oct 20 14:33:47 user nova-compute[76870]:     </disk>
Oct 20 14:33:47 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:33:47 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:33:47 user nova-compute[76870]:       <source dev="/dev/sdj"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="vdc" bus="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <serial>741b4dcc-b82e-4af7-9601-d21d82356fbf</serial>
Oct 20 14:33:47 user nova-compute[76870]:     </disk>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:25:c2:9f"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tap44c4be28-14"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:10:5e:ef"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tape0a3fe71-4e"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:c3:b4:c0"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tap1bb94220-55"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:d6:f1:b1"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tap990044fc-5a"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:2c:0d:7a"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tapd78f5177-7d"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:10:1c:5a"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tap34d8a4f7-5c"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:33:47 user nova-compute[76870]:       <mac address="fa:16:3e:3d:5c:01"/>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:33:47 user nova-compute[76870]:       <target dev="tapeefb9952-70"/>
Oct 20 14:33:47 user nova-compute[76870]:     </interface>
Oct 20 14:33:47 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:33:47 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36/console.log" append="off"/>
Oct 20 14:33:47 user nova-compute[76870]:     </serial>
Oct 20 14:33:47 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:33:47 user nova-compute[76870]:     <video>
Oct 20 14:33:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:33:47 user nova-compute[76870]:     </video>
Oct 20 14:33:47 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:33:47 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:33:47 user nova-compute[76870]:     </rng>
Oct 20 14:33:47 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:33:47 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:33:47 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:33:47 user nova-compute[76870]:     </memballoon>
Oct 20 14:33:47 user nova-compute[76870]:   </devices>
Oct 20 14:33:47 user nova-compute[76870]: </domain>
Oct 20 14:33:47 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f19930-58b5-51e8-a291-b4194a463819', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-8be37183-d201-45a1-9e03-2071cc73d761 tempest-TestVolumeSwap-1069189186 tempest-TestVolumeSwap-1069189186-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4117f8b5-d40d-456e-835e-bd8941a7f296)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4117f8b5-d40d-456e-835e-bd8941a7f296)
Oct 20 14:33:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44c4be28-14, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44c4be28-14, col_values=(('qos', UUID('d97bf1bf-8a10-4709-8b9d-f6f3c07e5429')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44c4be28-14, col_values=(('external_ids', {'iface-id': '44c4be28-1456-4293-b59e-dc6ecf5d2bf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:c2:9f', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14')
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acf78ee2-a50b-5a99-b8a9-d07cc0cb1253', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0a3fe71-4e, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0a3fe71-4e, col_values=(('qos', UUID('902f6708-7207-4961-8f8c-74d9f1776cce')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0a3fe71-4e, col_values=(('external_ids', {'iface-id': 'e0a3fe71-4e0f-4cd7-80e7-5191c9397469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:5e:ef', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e')
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05cfa78f-db9e-59c1-83a4-5f6b9159e7b8', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb94220-55, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bb94220-55, col_values=(('qos', UUID('cc754554-551b-4653-9a10-0d43bcf42190')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bb94220-55, col_values=(('external_ids', {'iface-id': '1bb94220-5586-400e-844c-6a83087ce4f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:b4:c0', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55')
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e931aee-cb81-54dd-a0d4-bb9f7328300f', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap990044fc-5a, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap990044fc-5a, col_values=(('qos', UUID('aced033e-aa19-4a7e-80e0-b2b69fe0be80')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap990044fc-5a, col_values=(('external_ids', {'iface-id': '990044fc-5a03-4382-8c07-403709389e6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:f1:b1', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a')
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a535d90-53cd-5fbd-ad05-e72b98ff1d03', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd78f5177-7d, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd78f5177-7d, col_values=(('qos', UUID('a855dd24-bca2-426d-9aad-1b414a4423d0')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd78f5177-7d, col_values=(('external_ids', {'iface-id': 'd78f5177-7d40-4ce0-ac07-63126fa6d312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:0d:7a', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d')
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd47328d2-984d-53b5-8230-2da1b609636f', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34d8a4f7-5c, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34d8a4f7-5c, col_values=(('qos', UUID('868e01f0-c4b5-4fd8-9e41-0812ca81547c')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34d8a4f7-5c, col_values=(('external_ids', {'iface-id': '34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:1c:5a', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c')
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fe436f0-8fbf-54d2-a898-5848ae1f82e6', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeefb9952-70, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeefb9952-70, col_values=(('qos', UUID('73ca37c6-b9c2-4fd7-a266-46b7d89a961b')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeefb9952-70, col_values=(('external_ids', {'iface-id': 'eefb9952-705b-4911-b643-7f7ddbcbc0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:5c:01', 'vm-uuid': '44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:48 user nova-compute[76870]: INFO os_vif [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70')
Oct 20 14:33:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] No BDM found with device name hda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] No VIF found with MAC fa:16:3e:25:c2:9f, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] No VIF found with MAC fa:16:3e:2c:0d:7a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:33:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Using config drive
Oct 20 14:33:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Creating config drive at /opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36/disk.config
Oct 20 14:33:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjeimr3pc {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjeimr3pc" returned: 0 in 0.053s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-001e0bc9-39e5-44d4-8757-ce40aed6e39f req-9306c2d3-104e-4b20-85f4-b25942b166ae service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-001e0bc9-39e5-44d4-8757-ce40aed6e39f req-9306c2d3-104e-4b20-85f4-b25942b166ae service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-001e0bc9-39e5-44d4-8757-ce40aed6e39f req-9306c2d3-104e-4b20-85f4-b25942b166ae service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-001e0bc9-39e5-44d4-8757-ce40aed6e39f req-9306c2d3-104e-4b20-85f4-b25942b166ae service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-001e0bc9-39e5-44d4-8757-ce40aed6e39f req-9306c2d3-104e-4b20-85f4-b25942b166ae service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:50 user nova-compute[76870]: WARNING nova.compute.manager [req-001e0bc9-39e5-44d4-8757-ce40aed6e39f req-9306c2d3-104e-4b20-85f4-b25942b166ae service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 for instance with vm_state building and task_state spawning.
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-fca66abe-4151-41b4-8310-5d1fc48f31d4 req-11b5aae9-5376-40ca-83d4-d91838605358 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fca66abe-4151-41b4-8310-5d1fc48f31d4 req-11b5aae9-5376-40ca-83d4-d91838605358 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fca66abe-4151-41b4-8310-5d1fc48f31d4 req-11b5aae9-5376-40ca-83d4-d91838605358 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fca66abe-4151-41b4-8310-5d1fc48f31d4 req-11b5aae9-5376-40ca-83d4-d91838605358 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-fca66abe-4151-41b4-8310-5d1fc48f31d4 req-11b5aae9-5376-40ca-83d4-d91838605358 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:50 user nova-compute[76870]: WARNING nova.compute.manager [req-fca66abe-4151-41b4-8310-5d1fc48f31d4 req-11b5aae9-5376-40ca-83d4-d91838605358 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 for instance with vm_state building and task_state spawning.
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ed7798f-e96a-4ab3-9038-f9a9674360f3 req-42950d48-3c93-4378-9587-90755adbf0c7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ed7798f-e96a-4ab3-9038-f9a9674360f3 req-42950d48-3c93-4378-9587-90755adbf0c7 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ed7798f-e96a-4ab3-9038-f9a9674360f3 req-42950d48-3c93-4378-9587-90755adbf0c7 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ed7798f-e96a-4ab3-9038-f9a9674360f3 req-42950d48-3c93-4378-9587-90755adbf0c7 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ed7798f-e96a-4ab3-9038-f9a9674360f3 req-42950d48-3c93-4378-9587-90755adbf0c7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:50 user nova-compute[76870]: WARNING nova.compute.manager [req-9ed7798f-e96a-4ab3-9038-f9a9674360f3 req-42950d48-3c93-4378-9587-90755adbf0c7 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 for instance with vm_state building and task_state spawning.
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-3317ba39-b240-4e72-b5ff-5ae5d1e8b21a req-fda919c5-80be-4ef5-83b7-b3500885ea95 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-b59be37a-2485-4ad2-9381-8ed25ca07a41 req-b323e23e-2fc7-425d-9d62-4fef49732595 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e for instance with vm_state building and task_state spawning.
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:52 user nova-compute[76870]: WARNING nova.compute.manager [req-48dfe798-de57-4716-b049-94191f46c410 req-6df98d37-4019-4e04-86b1-ac3dd94666c6 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e for instance with vm_state building and task_state spawning.
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:33:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance spawned successfully.
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-749abbf2-2b1e-4894-b7e3-516d0e8ae261 req-02eb103d-1c91-495e-8237-c420412bc750 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-749abbf2-2b1e-4894-b7e3-516d0e8ae261 req-02eb103d-1c91-495e-8237-c420412bc750 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-749abbf2-2b1e-4894-b7e3-516d0e8ae261 req-02eb103d-1c91-495e-8237-c420412bc750 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-749abbf2-2b1e-4894-b7e3-516d0e8ae261 req-02eb103d-1c91-495e-8237-c420412bc750 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-749abbf2-2b1e-4894-b7e3-516d0e8ae261 req-02eb103d-1c91-495e-8237-c420412bc750 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:33:54 user nova-compute[76870]: WARNING nova.compute.manager [req-749abbf2-2b1e-4894-b7e3-516d0e8ae261 req-02eb103d-1c91-495e-8237-c420412bc750 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 for instance with vm_state building and task_state spawning.
Oct 20 14:33:54 user nova-compute[76870]: INFO nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Took 12.33 seconds to spawn the instance on the hypervisor.
Oct 20 14:33:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:33:54 user nova-compute[76870]: INFO nova.compute.manager [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Took 93.35 seconds to build instance.
Oct 20 14:33:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-df1f731c-f0ff-4c3d-a41c-5b68bbc5eb33 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 93.698s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:33:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:33:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:02 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance cc506fab-01ee-4944-b09f-f97fd0c21c77 is timed out.
Oct 20 14:34:02 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Successfully detached device sdc from instance cc506fab-01ee-4944-b09f-f97fd0c21c77 from the live domain config.
Oct 20 14:34:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruXOlshc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:34:02 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad71c6-9b13-4efc-85fc-70af0e381f2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:34:02 user nova-compute[76870]: No targets found.
Oct 20 14:34:02 user nova-compute[76870]: iSNS:
Oct 20 14:34:02 user nova-compute[76870]: No targets found.
Oct 20 14:34:02 user nova-compute[76870]: STATIC:
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:34:02 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:02 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:02 user nova-compute[76870]: FIRMWARE:
Oct 20 14:34:02 user nova-compute[76870]: No targets found.
Oct 20 14:34:02 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:34:02 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:34:02 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d696bac-374a-429d-bfc9-79eb12b61c5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[70996bf1-6c5c-4df9-9f53-0dd79a242656]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:34:02 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 (non-flash)
Oct 20 14:34:02 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:34:02 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c5b8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4'): ({'sdg'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Removing single pathed devices sdg {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d5de0-1b50-4846-941c-db6a12b4f7a0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52d3dc-3263-4c8b-a250-fe58d56d217d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Flushing IO for device /dev/sdg {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[25401cc6-ed83-45b0-a9c8-6e395a59604c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdaf612-8003-4d05-af17-10e23c687f99]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] SCSI volumes sdg have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ec92e-84b2-4c18-916e-6279a913e02a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544c7cd-5841-44e9-ba7a-04afdd7948be]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260]
Oct 20 14:34:02 user nova-compute[76870]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4, portal: 172.16.0.220,3260] successful.
Oct 20 14:34:02 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dab79a92-c729-441d-af33-286489ef36b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06855e0-f16e-43f3-b54f-c6b1cc5035fe]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] <== disconnect_volume: return (388ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:34:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:34:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:03 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lazy-loading 'flavor' on Instance uuid cc506fab-01ee-4944-b09f-f97fd0c21c77 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f8af9a48-3ac3-4aed-8d79-6da6dc70a365 tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.025s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:04 user nova-compute[76870]: INFO nova.compute.manager [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Terminating instance
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-786a8a01-3d7f-4db8-8387-699cdc8134e2 req-9b608b4d-15a5-4eb4-ad1b-5cece362479a service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-vif-unplugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-786a8a01-3d7f-4db8-8387-699cdc8134e2 req-9b608b4d-15a5-4eb4-ad1b-5cece362479a service nova] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-786a8a01-3d7f-4db8-8387-699cdc8134e2 req-9b608b4d-15a5-4eb4-ad1b-5cece362479a service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-786a8a01-3d7f-4db8-8387-699cdc8134e2 req-9b608b4d-15a5-4eb4-ad1b-5cece362479a service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-786a8a01-3d7f-4db8-8387-699cdc8134e2 req-9b608b4d-15a5-4eb4-ad1b-5cece362479a service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] No waiting events found dispatching network-vif-unplugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-786a8a01-3d7f-4db8-8387-699cdc8134e2 req-9b608b4d-15a5-4eb4-ad1b-5cece362479a service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-vif-unplugged-95871811-8a03-4445-9469-aa9fe96bcdd9 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:34:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62254105-7623-4f3c-923b-f3cb7d304044 is timed out.
Oct 20 14:34:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Successfully detached device vdb from instance 62254105-7623-4f3c-923b-f3cb7d304044 from the live domain config.
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOqmSZfX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:34:04 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a1466f-e594-4f7a-ba0e-dd952621f933]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:34:04 user nova-compute[76870]: No targets found.
Oct 20 14:34:04 user nova-compute[76870]: iSNS:
Oct 20 14:34:04 user nova-compute[76870]: No targets found.
Oct 20 14:34:04 user nova-compute[76870]: STATIC:
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:34:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:04 user nova-compute[76870]: FIRMWARE:
Oct 20 14:34:04 user nova-compute[76870]: No targets found.
Oct 20 14:34:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:34:04 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:34:04 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6383cde-c712-423b-9969-c2801c0045ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d3b98-564b-48d5-aa81-f58ea9966fdf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:34:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:04 user nova-compute[76870]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a (non-flash)
Oct 20 14:34:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c5b9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a'): ({'sdh'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Removing single pathed devices sdh {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ac1d5d-e4d0-4185-852b-9140b9dde577]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[70205c41-a23c-4cc6-b2b7-6c17a7cd5cd9]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Flushing IO for device /dev/sdh {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdcfc76-c4e2-4667-83fd-c839a817a3cc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Instance destroyed successfully.
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lazy-loading 'resources' on Instance uuid cc506fab-01ee-4944-b09f-f97fd0c21c77 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1680072135',display_name='tempest-AttachSCSIVolumeTestJSON-server-1680072135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1680072135',id=5,image_ref='377cdc91-9ffc-4382-a473-635447ba359a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyOc9SsFuZu1uYLxG/Eemg0AlMBs1Ah6WZQdNMymSouCLA2m5PSpVSybF8OfDZBvKAxBohSHKfblRD5RW75R/OT7rx6yN/wnI7jkEMvDvrLpbM95ZgZ4CdjjUSP88TQLQ==',key_name='tempest-keypair-1192210980',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:31:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ef293efe943499dad6ec1dafa8ac9a4',ramdisk_id='',reservation_id='r-e0dmdrra',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='377cdc91-9ffc-4382-a473-635447ba359a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-550858638',owner_user_name='tempest-AttachSCSIVolumeTestJSON-550858638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f98270a4554d29845e8dea8221cb05',uuid=cc506fab-01ee-4944-b09f-f97fd0c21c77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Converting VIF {"id": "95871811-8a03-4445-9469-aa9fe96bcdd9", "address": "fa:16:3e:f8:ff:9a", "network": {"id": "f993065c-86c5-499e-8e6d-adb7da3c106f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1205369235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ef293efe943499dad6ec1dafa8ac9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95871811-8a", "ovs_interfaceid": "95871811-8a03-4445-9469-aa9fe96bcdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_vif [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95871811-8a, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[706bee3d-a429-4fcb-b3d4-b6fe8c9af3d9]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] SCSI volumes sdh have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4892b554-335a-4da1-84b9-30800989ad3e) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:04 user nova-compute[76870]: INFO os_vif [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ff:9a,bridge_name='br-int',has_traffic_filtering=True,id=95871811-8a03-4445-9469-aa9fe96bcdd9,network=Network(f993065c-86c5-499e-8e6d-adb7da3c106f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95871811-8a')
Oct 20 14:34:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Deleting instance files /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77_del
Oct 20 14:34:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Deletion of /opt/stack/data/nova/instances/cc506fab-01ee-4944-b09f-f97fd0c21c77_del complete
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7ec77c-ad1a-49d0-93d3-65c7a6c45644]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:05 user nova-compute[76870]: INFO nova.compute.manager [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 14:34:05 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6930c0-bbba-4cc5-84ec-b40a40fdc92f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260]
Oct 20 14:34:05 user nova-compute[76870]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a, portal: 172.16.0.220,3260] successful.
Oct 20 14:34:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653fde4c-7895-425f-beae-2daf9caee86a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[924366a2-febe-4dd8-8caf-4f0fee30b5d4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] <== disconnect_volume: return (447ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:34:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lazy-loading 'flavor' on Instance uuid 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d99ed044-cef1-4bfd-a433-607233cc709f tempest-VolumesAssistedSnapshotsTest-113830063 tempest-VolumesAssistedSnapshotsTest-113830063-project-admin] Lock "62254105-7623-4f3c-923b-f3cb7d304044" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.153s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:06 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Took 1.31 seconds to deallocate network for instance.
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc8401bd-6080-447c-8670-0b3abd7155c5 req-25b3cf3d-1d57-4cf4-8cec-d4550e0867ad service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-vif-deleted-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:06 user nova-compute[76870]: INFO nova.compute.manager [req-dc8401bd-6080-447c-8670-0b3abd7155c5 req-25b3cf3d-1d57-4cf4-8cec-d4550e0867ad service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Neutron deleted interface 95871811-8a03-4445-9469-aa9fe96bcdd9; detaching it from the instance and deleting it from the info cache
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-dc8401bd-6080-447c-8670-0b3abd7155c5 req-25b3cf3d-1d57-4cf4-8cec-d4550e0867ad service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc8401bd-6080-447c-8670-0b3abd7155c5 req-25b3cf3d-1d57-4cf4-8cec-d4550e0867ad service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Detach interface failed, port_id=95871811-8a03-4445-9469-aa9fe96bcdd9, reason: Instance cc506fab-01ee-4944-b09f-f97fd0c21c77 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-e7a30cdf-f47c-40d9-8525-c1e22ef54c03 req-5500a865-ee63-4b5e-92c1-c39562d2ffc8 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received event network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e7a30cdf-f47c-40d9-8525-c1e22ef54c03 req-5500a865-ee63-4b5e-92c1-c39562d2ffc8 service nova] Acquiring lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e7a30cdf-f47c-40d9-8525-c1e22ef54c03 req-5500a865-ee63-4b5e-92c1-c39562d2ffc8 service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e7a30cdf-f47c-40d9-8525-c1e22ef54c03 req-5500a865-ee63-4b5e-92c1-c39562d2ffc8 service nova] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-e7a30cdf-f47c-40d9-8525-c1e22ef54c03 req-5500a865-ee63-4b5e-92c1-c39562d2ffc8 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] No waiting events found dispatching network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:06 user nova-compute[76870]: WARNING nova.compute.manager [req-e7a30cdf-f47c-40d9-8525-c1e22ef54c03 req-5500a865-ee63-4b5e-92c1-c39562d2ffc8 service nova] [instance: cc506fab-01ee-4944-b09f-f97fd0c21c77] Received unexpected event network-vif-plugged-95871811-8a03-4445-9469-aa9fe96bcdd9 for instance with vm_state deleted and task_state None.
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:34:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:06 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Deleted allocations for instance cc506fab-01ee-4944-b09f-f97fd0c21c77
Oct 20 14:34:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8caea9a3-e628-4047-870f-4fc20b4ac99e tempest-AttachSCSIVolumeTestJSON-550858638 tempest-AttachSCSIVolumeTestJSON-550858638-project-member] Lock "cc506fab-01ee-4944-b09f-f97fd0c21c77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.963s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG nova.objects.instance [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lazy-loading 'flavor' on Instance uuid a734d0c6-9dff-4254-9231-040de2c5eacc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:22 user nova-compute[76870]: INFO nova.compute.manager [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Attaching volume 8e49792e-f3ee-4ce7-9665-d8215f308c45 to /dev/vdb
Oct 20 14:34:22 user nova-compute[76870]: DEBUG os_brick.utils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77b1382-5200-4b8a-96b9-1f2e73fa2332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[090adbcf-afe2-4143-a0f7-e7224661c016]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103ee5e-6814-40a2-8e66-e01edec64bb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e0fb2-021e-46bd-8b85-ed4b7edbff5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:34:22 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:34:22 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6165e-bd23-4e1d-a098-ef91587d4aae]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG os_brick.utils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:34:22 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating existing volume attachment record: 00d51a96-9439-4f4c-a732-358ba6fb8e67 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:34:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:34:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:34:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:34:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:34:26 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:34:27 user nova-compute[76870]: INFO nova.compute.claims [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Claim successful on node user
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating instance_info_cache with network_info: [{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.354s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:34:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG nova.policy [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e65eb07d084dcb9e5e9188961f4b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8ea9d998b4ba587b16fec8b792c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:34:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Creating image(s)
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "/opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "/opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "/opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.247s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.218s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk 1073741824" returned: 0 in 0.091s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Successfully created port: a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.216s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:34:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Cannot resize image /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Ensure instance console log exists: /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Successfully updated port: a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquired lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-changed-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Refreshing instance network info cache due to event network-changed-a013c6d2-9a71-4087-be3d-e3f42d0ee608. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] Acquiring lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Releasing lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance network_info: |[{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] Acquired lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Refreshing network info cache for port a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Start _get_guest_xml network_info=[{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:29 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:34:29 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1239079696',display_name='tempest-tempest.common.compute-instance-1239079696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1239079696',id=11,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtWduLiSPzp/VIWUKHUa6UtA2knbF4Q50olmDaUXr/g/hom82515E7C8B1Pp5lBk6XIf+Ts5MHmM2RjJ9FLsPEJfZPdRT6D+WICkm8NU+kt+pvIZmBiyTVuZYgnHIt+pg==',key_name='tempest-keypair-115946927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-tas7lovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=663ff166-5934-49b0-bb00-4600c1c31b08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.objects.instance [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'pci_devices' on Instance uuid 663ff166-5934-49b0-bb00-4600c1c31b08 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:34:29 user nova-compute[76870]:   <uuid>663ff166-5934-49b0-bb00-4600c1c31b08</uuid>
Oct 20 14:34:29 user nova-compute[76870]:   <name>instance-0000000b</name>
Oct 20 14:34:29 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:34:29 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:34:29 user nova-compute[76870]:   <metadata>
Oct 20 14:34:29 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:34:29 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:34:29 user nova-compute[76870]:       <nova:name>tempest-tempest.common.compute-instance-1239079696</nova:name>
Oct 20 14:34:29 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:34:29</nova:creationTime>
Oct 20 14:34:29 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:34:29 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:34:29 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:34:29 user nova-compute[76870]:       <nova:owner>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:user uuid="91e65eb07d084dcb9e5e9188961f4b44">tempest-ServerActionsTestOtherA-404958601-project-member</nova:user>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:project uuid="94c8ea9d998b4ba587b16fec8b792c13">tempest-ServerActionsTestOtherA-404958601</nova:project>
Oct 20 14:34:29 user nova-compute[76870]:       </nova:owner>
Oct 20 14:34:29 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:34:29 user nova-compute[76870]:       <nova:ports>
Oct 20 14:34:29 user nova-compute[76870]:         <nova:port uuid="a013c6d2-9a71-4087-be3d-e3f42d0ee608">
Oct 20 14:34:29 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:34:29 user nova-compute[76870]:         </nova:port>
Oct 20 14:34:29 user nova-compute[76870]:       </nova:ports>
Oct 20 14:34:29 user nova-compute[76870]:     </nova:instance>
Oct 20 14:34:29 user nova-compute[76870]:   </metadata>
Oct 20 14:34:29 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:34:29 user nova-compute[76870]:     <system>
Oct 20 14:34:29 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:34:29 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:34:29 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:34:29 user nova-compute[76870]:       <entry name="serial">663ff166-5934-49b0-bb00-4600c1c31b08</entry>
Oct 20 14:34:29 user nova-compute[76870]:       <entry name="uuid">663ff166-5934-49b0-bb00-4600c1c31b08</entry>
Oct 20 14:34:29 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:34:29 user nova-compute[76870]:     </system>
Oct 20 14:34:29 user nova-compute[76870]:   </sysinfo>
Oct 20 14:34:29 user nova-compute[76870]:   <os>
Oct 20 14:34:29 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:34:29 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:34:29 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:34:29 user nova-compute[76870]:   </os>
Oct 20 14:34:29 user nova-compute[76870]:   <features>
Oct 20 14:34:29 user nova-compute[76870]:     <acpi/>
Oct 20 14:34:29 user nova-compute[76870]:     <apic/>
Oct 20 14:34:29 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:34:29 user nova-compute[76870]:   </features>
Oct 20 14:34:29 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:34:29 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:34:29 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:34:29 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:34:29 user nova-compute[76870]:   </clock>
Oct 20 14:34:29 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:34:29 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:34:29 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:34:29 user nova-compute[76870]:   </cpu>
Oct 20 14:34:29 user nova-compute[76870]:   <devices>
Oct 20 14:34:29 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:34:29 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:34:29 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk"/>
Oct 20 14:34:29 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:34:29 user nova-compute[76870]:     </disk>
Oct 20 14:34:29 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:34:29 user nova-compute[76870]:       <mac address="fa:16:3e:47:0d:93"/>
Oct 20 14:34:29 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:34:29 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:34:29 user nova-compute[76870]:       <target dev="tapa013c6d2-9a"/>
Oct 20 14:34:29 user nova-compute[76870]:     </interface>
Oct 20 14:34:29 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:34:29 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/console.log" append="off"/>
Oct 20 14:34:29 user nova-compute[76870]:     </serial>
Oct 20 14:34:29 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:34:29 user nova-compute[76870]:     <video>
Oct 20 14:34:29 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:34:29 user nova-compute[76870]:     </video>
Oct 20 14:34:29 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:34:29 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:34:29 user nova-compute[76870]:     </rng>
Oct 20 14:34:29 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:34:29 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:34:29 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:34:29 user nova-compute[76870]:     </memballoon>
Oct 20 14:34:29 user nova-compute[76870]:   </devices>
Oct 20 14:34:29 user nova-compute[76870]: </domain>
Oct 20 14:34:29 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1239079696',display_name='tempest-tempest.common.compute-instance-1239079696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1239079696',id=11,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtWduLiSPzp/VIWUKHUa6UtA2knbF4Q50olmDaUXr/g/hom82515E7C8B1Pp5lBk6XIf+Ts5MHmM2RjJ9FLsPEJfZPdRT6D+WICkm8NU+kt+pvIZmBiyTVuZYgnHIt+pg==',key_name='tempest-keypair-115946927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-tas7lovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=663ff166-5934-49b0-bb00-4600c1c31b08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG os_vif [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f83a78a7-0b44-5d59-a501-212516019c0c', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa013c6d2-9a, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa013c6d2-9a, col_values=(('qos', UUID('68dcb5a2-a92a-4a97-8b4e-2eaf83c54050')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa013c6d2-9a, col_values=(('external_ids', {'iface-id': 'a013c6d2-9a71-4087-be3d-e3f42d0ee608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:0d:93', 'vm-uuid': '663ff166-5934-49b0-bb00-4600c1c31b08'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:34:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:29 user nova-compute[76870]: INFO os_vif [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a')
Oct 20 14:34:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No VIF found with MAC fa:16:3e:47:0d:93, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:34:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:34:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7874MB free_disk=25.57282257080078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a734d0c6-9dff-4254-9231-040de2c5eacc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 62254105-7623-4f3c-923b-f3cb7d304044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 122e112c-ed24-4206-bbc0-2e9c0feca923 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 663ff166-5934-49b0-bb00-4600c1c31b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updated VIF entry in instance network info cache for port a013c6d2-9a71-4087-be3d-e3f42d0ee608. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ac9c99a0-5d20-40d0-9c48-a6f3b279a056 req-6fd2fb5a-4303-42d6-8199-74990e7c2ec1 service nova] Releasing lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-92070d79-cc59-4827-bcf0-e876e945c31e req-a293cace-65f3-407a-b5a0-9229852a7915 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-92070d79-cc59-4827-bcf0-e876e945c31e req-a293cace-65f3-407a-b5a0-9229852a7915 service nova] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-92070d79-cc59-4827-bcf0-e876e945c31e req-a293cace-65f3-407a-b5a0-9229852a7915 service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-92070d79-cc59-4827-bcf0-e876e945c31e req-a293cace-65f3-407a-b5a0-9229852a7915 service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-92070d79-cc59-4827-bcf0-e876e945c31e req-a293cace-65f3-407a-b5a0-9229852a7915 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] No waiting events found dispatching network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:31 user nova-compute[76870]: WARNING nova.compute.manager [req-92070d79-cc59-4827-bcf0-e876e945c31e req-a293cace-65f3-407a-b5a0-9229852a7915 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received unexpected event network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 for instance with vm_state building and task_state spawning.
Oct 20 14:34:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-e3d8f676-94ef-4668-bdb1-054058c4b875 req-7a074f0b-7993-4c26-877a-b3bb94814253 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e3d8f676-94ef-4668-bdb1-054058c4b875 req-7a074f0b-7993-4c26-877a-b3bb94814253 service nova] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e3d8f676-94ef-4668-bdb1-054058c4b875 req-7a074f0b-7993-4c26-877a-b3bb94814253 service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e3d8f676-94ef-4668-bdb1-054058c4b875 req-7a074f0b-7993-4c26-877a-b3bb94814253 service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-e3d8f676-94ef-4668-bdb1-054058c4b875 req-7a074f0b-7993-4c26-877a-b3bb94814253 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] No waiting events found dispatching network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:33 user nova-compute[76870]: WARNING nova.compute.manager [req-e3d8f676-94ef-4668-bdb1-054058c4b875 req-7a074f0b-7993-4c26-877a-b3bb94814253 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received unexpected event network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 for instance with vm_state building and task_state spawning.
Oct 20 14:34:33 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance spawned successfully.
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:34:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:33 user nova-compute[76870]: INFO nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Took 5.80 seconds to spawn the instance on the hypervisor.
Oct 20 14:34:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:34:33 user nova-compute[76870]: INFO nova.compute.manager [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Took 6.74 seconds to build instance.
Oct 20 14:34:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-6e9d29c3-b5a5-4202-8058-ef9bcf3841d4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.854s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPMaChbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:34:44 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:34:44 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:34:44 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b455923b-64f6-4fbd-a144-9ca43216ed27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:34:44 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b618c05-0b8c-4c9c-8fa8-d5c743db807c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45] added
Oct 20 14:34:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56e5695-0cb9-49ac-bc74-67ab3d339915]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[136eeafc-3f18-4ee6-bc3e-3ae7b2b53ddb]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPMaChbA {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPMaChbA" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5f1f24-86eb-4053-9e75-b88ae2f9d5f9]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TPMaChbA'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b953bd-4a00-43cc-9eb2-3f74d8055e26]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f805a-f6ae-4ca3-80bb-07937255a02f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee374a7-eba8-46c1-ae16-e087a0a0cc44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260]
Oct 20 14:34:44 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260] successful.
Oct 20 14:34:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[22963d37-7e7f-49a9-82bb-8fcc1eb61e59]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63bdc19-d694-4aa0-a294-8f76aa883c1e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193bf84-48f0-4a13-844c-413b1ccaa6bf]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:34:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPMaChbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26431633634636663', 'path': '/dev/sdg'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431633634636663', 'path': '/dev/sdg'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG nova.objects.instance [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lazy-loading 'flavor' on Instance uuid a734d0c6-9dff-4254-9231-040de2c5eacc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:34:45 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:34:45 user nova-compute[76870]:   <source dev="/dev/sdg"/>
Oct 20 14:34:45 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:34:45 user nova-compute[76870]:   <serial>8e49792e-f3ee-4ce7-9665-d8215f308c45</serial>
Oct 20 14:34:45 user nova-compute[76870]: </disk>
Oct 20 14:34:45 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:34:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:34:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:34:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] No VIF found with MAC fa:16:3e:c8:d2:ab, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:34:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-54800200-7934-44d4-b9c5-2d2124920dd3 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.623s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:47 user nova-compute[76870]: WARNING nova.compute.manager [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Timeout waiting for ['volume-reimaged-85145293-1072-4fa3-bfd2-91ed71a8cc83'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-85145293-1072-4fa3-bfd2-91ed71a8cc83: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Oct 20 14:34:47 user nova-compute[76870]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7febf8527880 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Oct 20 14:34:47 user nova-compute[76870]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Oct 20 14:34:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:47 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:34:47 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:34:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:47 user nova-compute[76870]: INFO nova.compute.manager [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Successfully reverted task state from rebuilding on failure for instance.
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-13e34311-e989-4996-892f-8b7a1879de85 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Exception during message handling: ValueError: Circular reference detected
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     next(self.gen)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Oct 20 14:34:47 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:34:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Stashing vm_state: active {{(pid=76870) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:34:48 user nova-compute[76870]: INFO nova.compute.claims [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Claim successful on node user
Oct 20 14:34:48 user nova-compute[76870]: INFO nova.compute.resource_tracker [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating resource usage from migration 8b67dc21-5e29-4456-9791-baffd97ae913
Oct 20 14:34:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.452s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:48 user nova-compute[76870]: INFO nova.compute.manager [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Migrating
Oct 20 14:34:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:34:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquired lock "compute-rpcapi-router" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:34:48 user nova-compute[76870]: INFO nova.compute.rpcapi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 14:34:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Releasing lock "compute-rpcapi-router" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquired lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Releasing lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Starting migrate_disk_and_power_off {{(pid=76870) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-de7aff20-a3c4-49e1-ba63-1457005760cc req-4ad82934-b731-48d4-8d00-2534d72217cf service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-vif-unplugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de7aff20-a3c4-49e1-ba63-1457005760cc req-4ad82934-b731-48d4-8d00-2534d72217cf service nova] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de7aff20-a3c4-49e1-ba63-1457005760cc req-4ad82934-b731-48d4-8d00-2534d72217cf service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de7aff20-a3c4-49e1-ba63-1457005760cc req-4ad82934-b731-48d4-8d00-2534d72217cf service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-de7aff20-a3c4-49e1-ba63-1457005760cc req-4ad82934-b731-48d4-8d00-2534d72217cf service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] No waiting events found dispatching network-vif-unplugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:49 user nova-compute[76870]: WARNING nova.compute.manager [req-de7aff20-a3c4-49e1-ba63-1457005760cc req-4ad82934-b731-48d4-8d00-2534d72217cf service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received unexpected event network-vif-unplugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 for instance with vm_state active and task_state resize_migrating.
Oct 20 14:34:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance destroyed successfully.
Oct 20 14:34:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-421716088',display_name='tempest-ServerActionsTestOtherB-server-421716088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-421716088',id=1,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5J1bkU05EsA9oLI2fFKX8jeghB7OrfieDYZJWE7wot0V9HQuQJYNbZk0BZfAsp4fuH8lc38ZICaToK7lrfRSosV9s8NqH/c8C3FaEjKVHZC1H80U+qw7HizpqyaPVw2g==',key_name='tempest-keypair-1128736685',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29ff7a7bc4204024a9e126a78a8c45bb',ramdisk_id='',reservation_id='r-8yrn360w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1628594369',owner_user_name='tempest-ServerActionsTestOtherB-1628594369-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:34:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37fcf98d035d4ed8a6de3a15e78d3318',uuid=a734d0c6-9dff-4254-9231-040de2c5eacc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1839464605-network", "vif_mac": "fa:16:3e:c8:d2:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converting VIF {"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1839464605-network", "vif_mac": "fa:16:3e:c8:d2:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_vif [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa15cefc7-71, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfb961f7-ea92-479a-b58b-5ae635d12043) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:34:50 user nova-compute[76870]: INFO os_vif [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71')
Oct 20 14:34:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPMaChbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:34:50 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.044s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4553ff-663c-4052-a81c-eacd7e8f43fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:34:50 user nova-compute[76870]: No targets found.
Oct 20 14:34:50 user nova-compute[76870]: iSNS:
Oct 20 14:34:50 user nova-compute[76870]: No targets found.
Oct 20 14:34:50 user nova-compute[76870]: STATIC:
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:34:50 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:34:50 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:34:50 user nova-compute[76870]: FIRMWARE:
Oct 20 14:34:50 user nova-compute[76870]: No targets found.
Oct 20 14:34:50 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:34:50 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:34:50 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a7ec6-1d64-4ca4-91a2-4c1328aa8e44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d62e13a-4962-4b64-9685-850909382325]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:34:50 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8592c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45'): ({'sdg'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Removing single pathed devices sdg {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b21fc6f-27e0-4083-ac93-85237a91b9fa]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[861103f7-d35c-4b83-95f6-d2db036c0b67]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Flushing IO for device /dev/sdg {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[07637d58-5fc5-4afc-b407-cae12bd52a47]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89e8cee-f7d5-42a7-b27a-b5f30f676bc0]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] SCSI volumes sdg have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[776c4544-78cd-47d3-b350-cadc75ffac42]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf4e394-ce9d-45dc-b69e-4367785f737d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260]
Oct 20 14:34:50 user nova-compute[76870]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45, portal: 172.16.0.220,3260] successful.
Oct 20 14:34:50 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "62254105-7623-4f3c-923b-f3cb7d304044" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:50 user nova-compute[76870]: INFO nova.compute.manager [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Terminating instance
Oct 20 14:34:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e673c-aad9-431d-8286-85dab3307fca]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] <== disconnect_volume: return (417ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize/disk /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Instance destroyed successfully.
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.objects.instance [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lazy-loading 'resources' on Instance uuid 62254105-7623-4f3c-923b-f3cb7d304044 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1939218114',display_name='tempest-VolumesAssistedSnapshotsTest-server-1939218114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1939218114',id=7,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnGhGtTe3UC0KFgsNO0TPKMNe13aQgpugbhbaV9eq6uPpHnuGEbbZsyjKpTykw4QCKdKU/9o1KitTBkIMxL+TVgzgtDzEgVfsgNEq8r4jrwpMBS0C2EpxmV75pLkpSZHA==',key_name='tempest-keypair-1203971672',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15cea561bd634daaa32c8dfcae4dcd8d',ramdisk_id='',reservation_id='r-5dso1j1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397347504',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397347504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:31:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5392ac9b049f428fbe6c571e447ed404',uuid=62254105-7623-4f3c-923b-f3cb7d304044,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Converting VIF {"id": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "address": "fa:16:3e:f5:28:f9", "network": {"id": "ff57ca00-f3e7-469a-b56c-c8528bfc5e29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-926276816-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15cea561bd634daaa32c8dfcae4dcd8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5043bf-8e", "ovs_interfaceid": "5f5043bf-8e48-4aa3-8b03-de18ff8ef62d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG os_vif [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5043bf-8e, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b4c9a23-a274-4993-a1a9-e365be9926e8) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:51 user nova-compute[76870]: INFO os_vif [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:28:f9,bridge_name='br-int',has_traffic_filtering=True,id=5f5043bf-8e48-4aa3-8b03-de18ff8ef62d,network=Network(ff57ca00-f3e7-469a-b56c-c8528bfc5e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5043bf-8e')
Oct 20 14:34:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Deleting instance files /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044_del
Oct 20 14:34:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Deletion of /opt/stack/data/nova/instances/62254105-7623-4f3c-923b-f3cb7d304044_del complete
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "cp -r /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize/disk /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk" returned: 0 in 0.571s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize/disk.info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk.info {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] CMD "cp -r /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize/disk.info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk.info" returned: 0 in 0.037s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:34:51 user nova-compute[76870]: INFO nova.compute.manager [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 14:34:51 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:34:51 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] No waiting events found dispatching network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:52 user nova-compute[76870]: WARNING nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received unexpected event network-vif-plugged-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 for instance with vm_state active and task_state resize_migrating.
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-vif-unplugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] No waiting events found dispatching network-vif-unplugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-vif-unplugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Acquiring lock "62254105-7623-4f3c-923b-f3cb7d304044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] Lock "62254105-7623-4f3c-923b-f3cb7d304044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] No waiting events found dispatching network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:34:52 user nova-compute[76870]: WARNING nova.compute.manager [req-bff4d484-1d8d-4c14-a85f-2dc6cdaae5df req-f627240f-e33a-49e9-8809-da06a196ba2c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received unexpected event network-vif-plugged-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d for instance with vm_state active and task_state deleting.
Oct 20 14:34:52 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:34:52 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Took 0.95 seconds to deallocate network for instance.
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:53 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:34:53 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:34:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:53 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Deleted allocations for instance 62254105-7623-4f3c-923b-f3cb7d304044
Oct 20 14:34:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5b5a6896-1bb0-4948-8cb9-18727c52183c tempest-VolumesAssistedSnapshotsTest-1397347504 tempest-VolumesAssistedSnapshotsTest-1397347504-project-member] Lock "62254105-7623-4f3c-923b-f3cb7d304044" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.721s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-02a689db-7270-41c0-8fca-08e29dd2ba10 req-3ee088e5-9757-4f79-9dab-ec1aa6add79c service nova] [instance: 62254105-7623-4f3c-923b-f3cb7d304044] Received event network-vif-deleted-5f5043bf-8e48-4aa3-8b03-de18ff8ef62d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-13e34311-e989-4996-892f-8b7a1879de85 req-565f19f3-14f1-4dff-86dc-7e6c7ef8d370 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event volume-reimaged-85145293-1072-4fa3-bfd2-91ed71a8cc83 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:34:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13e34311-e989-4996-892f-8b7a1879de85 req-565f19f3-14f1-4dff-86dc-7e6c7ef8d370 service nova] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:34:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13e34311-e989-4996-892f-8b7a1879de85 req-565f19f3-14f1-4dff-86dc-7e6c7ef8d370 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:34:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13e34311-e989-4996-892f-8b7a1879de85 req-565f19f3-14f1-4dff-86dc-7e6c7ef8d370 service nova] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:34:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-13e34311-e989-4996-892f-8b7a1879de85 req-565f19f3-14f1-4dff-86dc-7e6c7ef8d370 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Processing event volume-reimaged-85145293-1072-4fa3-bfd2-91ed71a8cc83 {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 14:34:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:34:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Port a15cefc7-71b8-4c86-bf3d-ab69e98d6914 binding to destination host user is already ACTIVE {{(pid=76870) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquired lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:35:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [{"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Releasing lock "refresh_cache-a734d0c6-9dff-4254-9231-040de2c5eacc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc16f31d-2e69-490d-b564-402f54cdb251]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19336e9a-f08a-4024-9a00-78f29e39f36f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[230939ca-8f5a-432e-918d-f5b44bf9f0fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a26500-faf3-4cab-87ea-371fe59b0ec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:35:01 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53af8de-a488-44cc-aca0-eb3beabd07aa]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-changed-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing instance network info cache due to event network-changed-da0116b9-289d-49cd-838e-ca41dd4fc65c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] Acquiring lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] Acquired lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:35:01 user nova-compute[76870]: DEBUG nova.network.neutron [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Refreshing network info cache for port da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:35:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updated VIF entry in instance network info cache for port da0116b9-289d-49cd-838e-ca41dd4fc65c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:35:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-40f675eb-307f-4090-a2c6-4b9cbe69ad83 req-b9bd0513-c1d6-4640-ba14-cfc5f7d3ef80 service nova] Releasing lock "refresh_cache-122e112c-ed24-4206-bbc0-2e9c0feca923" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:35:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-changed-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing instance network info cache due to event network-changed-44c4be28-1456-4293-b59e-dc6ecf5d2bf2. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:35:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] Acquiring lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:35:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] Acquired lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:35:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Refreshing network info cache for port 44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:35:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updated VIF entry in instance network info cache for port 44c4be28-1456-4293-b59e-dc6ecf5d2bf2. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-82d5bb0c-ec58-4797-ae02-018ac0986449 req-bb61dedb-078d-4751-9484-83e4f4ca7252 service nova] Releasing lock "refresh_cache-44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:04 user nova-compute[76870]: INFO nova.compute.manager [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Terminating instance
Oct 20 14:35:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-173ae977-0007-4b34-8b70-0bad406613a5 req-5b184998-2113-44bd-a9f9-93035ef00469 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-173ae977-0007-4b34-8b70-0bad406613a5 req-5b184998-2113-44bd-a9f9-93035ef00469 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-173ae977-0007-4b34-8b70-0bad406613a5 req-5b184998-2113-44bd-a9f9-93035ef00469 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-173ae977-0007-4b34-8b70-0bad406613a5 req-5b184998-2113-44bd-a9f9-93035ef00469 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-173ae977-0007-4b34-8b70-0bad406613a5 req-5b184998-2113-44bd-a9f9-93035ef00469 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-173ae977-0007-4b34-8b70-0bad406613a5 req-5b184998-2113-44bd-a9f9-93035ef00469 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-da0116b9-289d-49cd-838e-ca41dd4fc65c for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:05 user nova-compute[76870]: WARNING nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-da0116b9-289d-49cd-838e-ca41dd4fc65c for instance with vm_state active and task_state deleting.
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:05 user nova-compute[76870]: WARNING nova.compute.manager [req-a1387cf4-944a-4678-940e-8a2421300fce req-957fae16-3719-43e6-8155-996d64647e90 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-2ee65f9a-2440-4423-b4a1-cbd24656d6be for instance with vm_state active and task_state deleting.
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:05 user nova-compute[76870]: INFO nova.compute.manager [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Terminating instance
Oct 20 14:35:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:35:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Instance destroyed successfully.
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lazy-loading 'resources' on Instance uuid 122e112c-ed24-4206-bbc0-2e9c0feca923 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda0116b9-28, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-f3fccedc-cb76-47d7-8e1f-9230c778b8ce req-988c1844-db84-4092-9afe-63f4c85a911c service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f3fccedc-cb76-47d7-8e1f-9230c778b8ce req-988c1844-db84-4092-9afe-63f4c85a911c service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f3fccedc-cb76-47d7-8e1f-9230c778b8ce req-988c1844-db84-4092-9afe-63f4c85a911c service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f3fccedc-cb76-47d7-8e1f-9230c778b8ce req-988c1844-db84-4092-9afe-63f4c85a911c service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-f3fccedc-cb76-47d7-8e1f-9230c778b8ce req-988c1844-db84-4092-9afe-63f4c85a911c service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-f3fccedc-cb76-47d7-8e1f-9230c778b8ce req-988c1844-db84-4092-9afe-63f4c85a911c service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-1bb94220-5586-400e-844c-6a83087ce4f1 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3cae223-d665-4648-8609-35e6f8bba4ec) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: WARNING nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-9dc70403-ae2b-4e23-9994-acb5e04ba8a9 for instance with vm_state active and task_state deleting.
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-32a4ac34-1e52-400d-884e-536bb1640f0e for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: WARNING nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-32a4ac34-1e52-400d-884e-536bb1640f0e for instance with vm_state active and task_state deleting.
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: WARNING nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-ece05121-0eef-4d74-b9e9-c9e95c71fb61 for instance with vm_state active and task_state deleting.
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: WARNING nova.compute.manager [req-63a9cd73-3913-4233-b957-f7e15e96282c req-ab0fc26b-055a-4b91-b628-d360680eee89 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-6a3e9c7b-9789-4d8b-a41f-1189add63dce for instance with vm_state active and task_state deleting.
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=da0116b9-289d-49cd-838e-ca41dd4fc65c,network=Network(41d96638-5a0f-4a8f-a5a0-0fe19cf060b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0116b9-28')
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dc70403-ae, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62f2a276-ba0c-4191-a187-d93e08d17a19) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: WARNING nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-e0a3fe71-4e0f-4cd7-80e7-5191c9397469 for instance with vm_state active and task_state deleting.
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: WARNING nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 for instance with vm_state active and task_state deleting.
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-b77f7ee4-6588-4955-b733-f1a999d71ea3 req-38a07662-7ccb-406b-9212-04c0cb04b983 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:08 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Instance destroyed successfully.
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.objects.instance [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lazy-loading 'resources' on Instance uuid 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44c4be28-14, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=9dc70403-ae2b-4e23-9994-acb5e04ba8a9,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9dc70403-ae')
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32a4ac34-1e, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d97bf1bf-8a10-4709-8b9d-f6f3c07e5429) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d110c217-2be6-4d45-b35d-0fb5c190b99d) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:c2:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2,network=Network(6d522e8d-7803-4c54-ba95-a1f73b0934a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4be28-14')
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0a3fe71-4e, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=32a4ac34-1e52-400d-884e-536bb1640f0e,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32a4ac34-1e')
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee65f9a-24, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:08 user nova-compute[76870]: WARNING nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-1bb94220-5586-400e-844c-6a83087ce4f1 for instance with vm_state active and task_state deleting.
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-990044fc-5a03-4382-8c07-403709389e6e for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:08 user nova-compute[76870]: WARNING nova.compute.manager [req-56daf610-95be-4a38-a390-d196a76fcd11 req-5bb69a7e-6ad4-436a-af16-2c6c983e2e01 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-990044fc-5a03-4382-8c07-403709389e6e for instance with vm_state active and task_state deleting.
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=902f6708-7207-4961-8f8c-74d9f1776cce) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2e6c82d-36fe-41c4-a920-b5f5b85893e7) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=e0a3fe71-4e0f-4cd7-80e7-5191c9397469,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0a3fe71-4e')
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bb94220-55, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:28,bridge_name='br-int',has_traffic_filtering=True,id=2ee65f9a-2440-4423-b4a1-cbd24656d6be,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee65f9a-24')
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "address": "fa:16:3e:79:cf:91", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapece05121-0e", "ovs_interfaceid": "ece05121-0eef-4d74-b9e9-c9e95c71fb61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapece05121-0e, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc754554-551b-4653-9a10-0d43bcf42190) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c92e210-2c41-409e-93b0-49b4acec154a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b4:c0,bridge_name='br-int',has_traffic_filtering=True,id=1bb94220-5586-400e-844c-6a83087ce4f1,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb94220-55')
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap990044fc-5a, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=ece05121-0eef-4d74-b9e9-c9e95c71fb61,network=Network(4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapece05121-0e')
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-unplugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-unplugged-b9165885-92ad-4c7c-aa4f-574594dd2913 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Acquiring lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] No waiting events found dispatching network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: WARNING nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received unexpected event network-vif-plugged-b9165885-92ad-4c7c-aa4f-574594dd2913 for instance with vm_state active and task_state deleting.
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: WARNING nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 for instance with vm_state active and task_state deleting.
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-unplugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-unplugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: WARNING nova.compute.manager [req-27393570-e63b-4b8d-b4ac-9543929749b1 req-0d780ba7-dd9d-4bcb-9074-f9b140d03084 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-d78f5177-7d40-4ce0-ac07-63126fa6d312 for instance with vm_state active and task_state deleting.
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a3e9c7b-97, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aced033e-aa19-4a7e-80e0-b2b69fe0be80) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b05bcee-b6f8-4b9d-9847-53339085f521) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:f1:b1,bridge_name='br-int',has_traffic_filtering=True,id=990044fc-5a03-4382-8c07-403709389e6e,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap990044fc-5a')
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "address": "fa:16:3e:2c:0d:7a", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd78f5177-7d", "ovs_interfaceid": "d78f5177-7d40-4ce0-ac07-63126fa6d312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd78f5177-7d, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1d:9e,bridge_name='br-int',has_traffic_filtering=True,id=6a3e9c7b-9789-4d8b-a41f-1189add63dce,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3e9c7b-97')
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-985980830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-985980830',id=9,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo9V2aLL5vykZixF1QntWyTPtE4gcVmc8o0+d8yLg6rqyzeEd9WKoZaw1uZ9Z7S88xch25GavbOW5bw8gNhr/W+jGyO0tgB+hN6zfucc9WBq5/c2iwyvSj/YLgNlde7XQ==',key_name='tempest-keypair-646189916',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='026fac370fef4694a8f7783536f16d14',ramdisk_id='',reservation_id='r-0k3b6kz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-413614803',owner_user_name='tempest-TaggedBootDevicesTest_v242-413614803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d054f71a7f134e5e9c8989fda21ff6bd',uuid=122e112c-ed24-4206-bbc0-2e9c0feca923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converting VIF {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-c9116255-592b-444d-abf7-b6924af472fe req-8993f155-a5c3-48e6-930b-1e0fdd73d091 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c9116255-592b-444d-abf7-b6924af472fe req-8993f155-a5c3-48e6-930b-1e0fdd73d091 service nova] Acquiring lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c9116255-592b-444d-abf7-b6924af472fe req-8993f155-a5c3-48e6-930b-1e0fdd73d091 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c9116255-592b-444d-abf7-b6924af472fe req-8993f155-a5c3-48e6-930b-1e0fdd73d091 service nova] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-c9116255-592b-444d-abf7-b6924af472fe req-8993f155-a5c3-48e6-930b-1e0fdd73d091 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] No waiting events found dispatching network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:35:09 user nova-compute[76870]: WARNING nova.compute.manager [req-c9116255-592b-444d-abf7-b6924af472fe req-8993f155-a5c3-48e6-930b-1e0fdd73d091 service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received unexpected event network-vif-plugged-eefb9952-705b-4911-b643-7f7ddbcbc0b7 for instance with vm_state active and task_state deleting.
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9165885-92, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a855dd24-bca2-426d-9aad-1b414a4423d0) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f584d007-f027-41cc-acee-e8019f5cfd73) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:0d:7a,bridge_name='br-int',has_traffic_filtering=True,id=d78f5177-7d40-4ce0-ac07-63126fa6d312,network=Network(2b18e983-0547-44eb-a148-5ac026894a5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd78f5177-7d')
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34d8a4f7-5c, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:10 user nova-compute[76870]: INFO os_vif [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:43:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9165885-92ad-4c7c-aa4f-574594dd2913,network=Network(5d1f41c7-4016-4bf1-be26-5665eca62b26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9165885-92')
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuyklCsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:10 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=868e01f0-c4b5-4fd8-9e41-0812ca81547c) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:5a,bridge_name='br-int',has_traffic_filtering=True,id=34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d8a4f7-5c')
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:32:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-391900128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-391900128',id=10,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIktnwLcrY2pZJl2pfbKTR1LenpXs6FJXSnW8zbQnwBXS63IKmUsyi3pU2EgNs3q1uiU0RABKQkFNPyXZu4Px4kHlG7xp5XtEHrtjkYFj5lwao6Bru4tlST3hKbK+7pi1A==',key_name='tempest-keypair-520156981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ae9c6a9c114b5b811c6f6c77aac86e',ramdisk_id='',reservation_id='r-8nil2px5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1650508878',owner_user_name='tempest-TaggedBootDevicesTest-1650508878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef3ed46cbe0a41e48a560c18c8733f40',uuid=44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converting VIF {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d82cbc-88e1-49d3-b9e2-93ee65787fbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]: iSNS:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]: STATIC:
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: FIRMWARE:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:35:10 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:35:10 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeefb9952-70, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73ca37c6-b9c2-4fd7-a266-46b7d89a961b) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:10 user nova-compute[76870]: INFO os_vif [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:01,bridge_name='br-int',has_traffic_filtering=True,id=eefb9952-705b-4911-b643-7f7ddbcbc0b7,network=Network(e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeefb9952-70')
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'madfTuqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:10 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c7c60d-6082-4ff0-9047-ae6a7e147547]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[688cebcf-80de-4449-b00e-e6908d8a6f78]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c545120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbf1f5d-6437-40a0-b8f5-7aad5a7a25e9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c312b6d4-cdc0-4b2d-8993-8c1f8ce07843]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75572a-380b-43f8-a25f-72cf746fdb8b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4411d2e6-42be-412c-8a1f-fe140b65b488]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd4d1e-c699-4c0d-8094-b5ffb91aa195]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc076b6-d0e2-44b5-8b0c-baab9d075285]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260]
Oct 20 14:35:10 user nova-compute[76870]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0, portal: 172.16.0.220,3260] successful.
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92d77c6b-4c27-4457-8504-72a0269428a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10423efb-f6f0-45e7-8082-7e45a133162a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== disconnect_volume: return (362ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.301s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNFgKilW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:10 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd67e5f1-8895-4f3c-9433-a7f9d705efda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]: iSNS:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]: STATIC:
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: FIRMWARE:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:35:10 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:35:10 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[89539caf-620e-4c83-8068-21f7230dba7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6014e2-3847-4dda-a43c-d9781a8a4dcf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c545120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984'): ({'sdi'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Removing single pathed devices sdi {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53732b62-e3e3-4a5d-b9c5-97f33ed20a6a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d3fff7-8eee-4539-b288-e8056e612274]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Flushing IO for device /dev/sdi {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee774ca-737a-4e26-b859-0d38cbb74c45]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc83c372-99de-453a-b786-bd530ad70685]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] SCSI volumes sdi have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7553b08-d55c-47ae-8af3-319c235ccafd]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2bf22d-2d51-48c8-9b7c-d773ebe6e21d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260]
Oct 20 14:35:10 user nova-compute[76870]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984, portal: 172.16.0.220,3260] successful.
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6232a67-b577-44c6-b385-fd18db4d0984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f481f1-a771-45c8-8607-0cad4aa6f644]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== disconnect_volume: return (648ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.346s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uOtfcIyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:10 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbd9e48-6439-4769-b65f-0fdf496b54d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]: iSNS:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]: STATIC:
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:35:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:10 user nova-compute[76870]: FIRMWARE:
Oct 20 14:35:10 user nova-compute[76870]: No targets found.
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:35:10 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:35:10 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af5f816-ca83-4b1d-ae39-0d8e845b07b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c20999b-85cd-40e6-9daa-3771fb4160ad]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c545120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68'): ({'sde'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Removing single pathed devices sde {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3b84d-bd3a-4b93-83d0-6633defe8113]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55e503f-ad0a-41fb-b762-24c0e2ff24a2]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Flushing IO for device /dev/sde {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f8d54-5dd2-4bcf-9961-d5e2340dd8ba]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[270003e6-18b2-4aa9-99fc-2b5f4044bd34]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaf6aa1-13b6-4bfd-9611-6684bf998ce8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cc1b4-e229-4228-a840-fbf5810e70d2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260]
Oct 20 14:35:11 user nova-compute[76870]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68, portal: 172.16.0.220,3260] successful.
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5049d394-b020-4e03-9319-5bb8c46ada68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc80ba16-236e-4b8b-843d-67a2fc2bae4b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== disconnect_volume: return (660ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.311s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CAvlWFTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:11 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2146c-6540-4f2f-966e-16ca384cb4c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]: iSNS:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]: STATIC:
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: FIRMWARE:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:35:11 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:35:11 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e364a-44b8-4704-b24d-713cb5a77012]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cbfe3e-e48c-492a-a0c6-3a41a25fd0de]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c545120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[021bb332-3813-49a2-b445-7683e0c79486]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e7d0a7-29b3-4ba6-868b-12bb7693ac35]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f22823-0cde-495b-8727-b8a38cf7d2be]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80c4fb-7b7d-4e18-be43-1b789c9e1c3f]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[147aa93d-9b2b-40f5-ac04-eefeadc7dba3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e8b29-6d23-4a13-985c-dfae15cad3ab]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260]
Oct 20 14:35:11 user nova-compute[76870]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd, portal: 172.16.0.220,3260] successful.
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5dc9f-9aa7-4e1c-9acd-ce797b67c5bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7c89a-a0f7-4852-8272-8bcb8bd5c384]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== disconnect_volume: return (622ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.308s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuHUvDBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:35:11 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4328b064-c26a-46a2-aaa3-afe9e25be6b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]: iSNS:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]: STATIC:
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: FIRMWARE:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:35:11 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:35:11 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f4e064-4d70-4672-bbb6-47f1bffc8a0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1324a-5cf5-47bc-80c2-eaed38e1d087]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c545120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5'): ({'sdf'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Removing single pathed devices sdf {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c07bff-70c5-4c76-8917-06afe7205cf1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[11063b6f-c872-4ca1-8e1a-6aa3fdedbb3d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Flushing IO for device /dev/sdf {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[32681d1e-70ab-4385-8f55-cbc9a648765e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f57333-53cd-4dad-be1e-5132910fcd10]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] SCSI volumes sdf have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6368f3-e73c-4579-b609-1acf43d77b6d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[886288c9-60e2-4799-a3d5-eac6d7e97678]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260]
Oct 20 14:35:11 user nova-compute[76870]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5, portal: 172.16.0.220,3260] successful.
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d616ccc-29a7-4c36-bb20-ee3ee32b93d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f510ad66-4788-4071-af06-91f6782622d2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] <== disconnect_volume: return (613ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:35:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Deleting instance files /opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923_del
Oct 20 14:35:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Deletion of /opt/stack/data/nova/instances/122e112c-ed24-4206-bbc0-2e9c0feca923_del complete
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.310s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c44382-42de-4505-889a-aecb0ac805ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]: iSNS:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]: STATIC:
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:35:11 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:35:11 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:35:11 user nova-compute[76870]: FIRMWARE:
Oct 20 14:35:11 user nova-compute[76870]: No targets found.
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:35:11 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:35:11 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c05373-864e-4fbd-b852-bc40f2dee131]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a402c31-71ac-4ce4-b8e0-0bbf6d8d69b1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf (non-flash)
Oct 20 14:35:11 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:35:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8590d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf'): ({'sdj'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Removing single pathed devices sdj {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: INFO nova.compute.manager [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Took 7.19 seconds to destroy the instance on the hypervisor.
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a611cf1-ec35-44b6-bc82-59c6f25d4501]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370c71f-af84-48e3-9977-17edbd8ab6a1]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Flushing IO for device /dev/sdj {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[524ae4d1-93de-4ebc-96db-7dcd17a0950d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d64b0d-db7b-454a-af7d-326c45c452be]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] SCSI volumes sdj have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c98d44-b3e4-4f6f-8349-393befdc1d83]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2012f6-00cb-4a39-92d4-d3e408251ad8]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260]
Oct 20 14:35:12 user nova-compute[76870]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf, portal: 172.16.0.220,3260] successful.
Oct 20 14:35:12 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741b4dcc-b82e-4af7-9601-d21d82356fbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94876c-4edf-42c2-9d33-f49215413095]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] <== disconnect_volume: return (686ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:35:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Deleting instance files /opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36_del
Oct 20 14:35:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Deletion of /opt/stack/data/nova/instances/44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36_del complete
Oct 20 14:35:12 user nova-compute[76870]: INFO nova.compute.manager [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Took 6.26 seconds to destroy the instance on the hypervisor.
Oct 20 14:35:12 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:35:12 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:35:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-3a816b65-71be-4978-91f5-ba11688fc5ea req-a285b990-daf0-446d-a1cd-90ac2b7fce56 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-deleted-ece05121-0eef-4d74-b9e9-c9e95c71fb61 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:14 user nova-compute[76870]: INFO nova.compute.manager [req-3a816b65-71be-4978-91f5-ba11688fc5ea req-a285b990-daf0-446d-a1cd-90ac2b7fce56 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Neutron deleted interface ece05121-0eef-4d74-b9e9-c9e95c71fb61; detaching it from the instance and deleting it from the info cache
Oct 20 14:35:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-3a816b65-71be-4978-91f5-ba11688fc5ea req-a285b990-daf0-446d-a1cd-90ac2b7fce56 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "address": "fa:16:3e:8e:1d:9e", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3e9c7b-97", "ovs_interfaceid": "6a3e9c7b-9789-4d8b-a41f-1189add63dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-3a816b65-71be-4978-91f5-ba11688fc5ea req-a285b990-daf0-446d-a1cd-90ac2b7fce56 service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Detach interface failed, port_id=ece05121-0eef-4d74-b9e9-c9e95c71fb61, reason: Instance 122e112c-ed24-4206-bbc0-2e9c0feca923 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:35:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-deleted-d78f5177-7d40-4ce0-ac07-63126fa6d312 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:16 user nova-compute[76870]: INFO nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Neutron deleted interface d78f5177-7d40-4ce0-ac07-63126fa6d312; detaching it from the instance and deleting it from the info cache
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "990044fc-5a03-4382-8c07-403709389e6e", "address": "fa:16:3e:d6:f1:b1", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990044fc-5a", "ovs_interfaceid": "990044fc-5a03-4382-8c07-403709389e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Detach interface failed, port_id=d78f5177-7d40-4ce0-ac07-63126fa6d312, reason: Instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-deleted-6a3e9c7b-9789-4d8b-a41f-1189add63dce {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:16 user nova-compute[76870]: INFO nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Neutron deleted interface 6a3e9c7b-9789-4d8b-a41f-1189add63dce; detaching it from the instance and deleting it from the info cache
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "address": "fa:16:3e:55:2d:54", "network": {"id": "41d96638-5a0f-4a8f-a5a0-0fe19cf060b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-795072358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0116b9-28", "ovs_interfaceid": "da0116b9-289d-49cd-838e-ca41dd4fc65c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Detach interface failed, port_id=6a3e9c7b-9789-4d8b-a41f-1189add63dce, reason: Instance 122e112c-ed24-4206-bbc0-2e9c0feca923 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-deleted-990044fc-5a03-4382-8c07-403709389e6e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:16 user nova-compute[76870]: INFO nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Neutron deleted interface 990044fc-5a03-4382-8c07-403709389e6e; detaching it from the instance and deleting it from the info cache
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "address": "fa:16:3e:25:c2:9f", "network": {"id": "6d522e8d-7803-4c54-ba95-a1f73b0934a2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1447772840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4be28-14", "ovs_interfaceid": "44c4be28-1456-4293-b59e-dc6ecf5d2bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Detach interface failed, port_id=990044fc-5a03-4382-8c07-403709389e6e, reason: Instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-deleted-da0116b9-289d-49cd-838e-ca41dd4fc65c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:16 user nova-compute[76870]: INFO nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Neutron deleted interface da0116b9-289d-49cd-838e-ca41dd4fc65c; detaching it from the instance and deleting it from the info cache
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [{"id": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "address": "fa:16:3e:49:d7:60", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc70403-ae", "ovs_interfaceid": "9dc70403-ae2b-4e23-9994-acb5e04ba8a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32a4ac34-1e52-400d-884e-536bb1640f0e", "address": "fa:16:3e:45:ed:fd", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32a4ac34-1e", "ovs_interfaceid": "32a4ac34-1e52-400d-884e-536bb1640f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "address": "fa:16:3e:2e:7c:28", "network": {"id": "4ee1e3d3-a3be-4bf2-b630-41fe7ea2c898", "bridge": "br-int", "label": "tempest-device-tagging-net1-2010319748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee65f9a-24", "ovs_interfaceid": "2ee65f9a-2440-4423-b4a1-cbd24656d6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9165885-92ad-4c7c-aa4f-574594dd2913", "address": "fa:16:3e:c3:43:ce", "network": {"id": "5d1f41c7-4016-4bf1-be26-5665eca62b26", "bridge": "br-int", "label": "tempest-device-tagging-net2-240761043", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "026fac370fef4694a8f7783536f16d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9165885-92", "ovs_interfaceid": "b9165885-92ad-4c7c-aa4f-574594dd2913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Detach interface failed, port_id=da0116b9-289d-49cd-838e-ca41dd4fc65c, reason: Instance 122e112c-ed24-4206-bbc0-2e9c0feca923 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-deleted-44c4be28-1456-4293-b59e-dc6ecf5d2bf2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:16 user nova-compute[76870]: INFO nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Neutron deleted interface 44c4be28-1456-4293-b59e-dc6ecf5d2bf2; detaching it from the instance and deleting it from the info cache
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [{"id": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "address": "fa:16:3e:10:5e:ef", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0a3fe71-4e", "ovs_interfaceid": "e0a3fe71-4e0f-4cd7-80e7-5191c9397469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1bb94220-5586-400e-844c-6a83087ce4f1", "address": "fa:16:3e:c3:b4:c0", "network": {"id": "2b18e983-0547-44eb-a148-5ac026894a5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-453725718", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb94220-55", "ovs_interfaceid": "1bb94220-5586-400e-844c-6a83087ce4f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "address": "fa:16:3e:10:1c:5a", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d8a4f7-5c", "ovs_interfaceid": "34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "address": "fa:16:3e:3d:5c:01", "network": {"id": "e35a3a7e-7ca0-4fb9-9cf1-a17015f75b4c", "bridge": "br-int", "label": "tempest-device-tagging-net2-787138587", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7ae9c6a9c114b5b811c6f6c77aac86e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeefb9952-70", "ovs_interfaceid": "eefb9952-705b-4911-b643-7f7ddbcbc0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5b7881dd-e982-4d8a-b8c3-d1350c7700f4 req-5cf54da9-9e9d-4ffb-98cf-fb8812f8059b service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Detach interface failed, port_id=44c4be28-1456-4293-b59e-dc6ecf5d2bf2, reason: Instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:35:17 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:17 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Took 5.48 seconds to deallocate network for instance.
Oct 20 14:35:17 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:17 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Took 5.21 seconds to deallocate network for instance.
Oct 20 14:35:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f3aed8d-ff17-48d6-ab6e-383a411dbcf4 req-871e9390-d20d-4d8f-bcbc-19e295ee84ee service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-deleted-b9165885-92ad-4c7c-aa4f-574594dd2913 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f3aed8d-ff17-48d6-ab6e-383a411dbcf4 req-871e9390-d20d-4d8f-bcbc-19e295ee84ee service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-deleted-34d8a4f7-5c2a-4fb8-8d6a-b6349c9c96c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f3aed8d-ff17-48d6-ab6e-383a411dbcf4 req-871e9390-d20d-4d8f-bcbc-19e295ee84ee service nova] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Received event network-vif-deleted-2ee65f9a-2440-4423-b4a1-cbd24656d6be {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f3aed8d-ff17-48d6-ab6e-383a411dbcf4 req-871e9390-d20d-4d8f-bcbc-19e295ee84ee service nova] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Received event network-vif-deleted-eefb9952-705b-4911-b643-7f7ddbcbc0b7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:35:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:20 user nova-compute[76870]: INFO nova.compute.manager [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] [instance: 122e112c-ed24-4206-bbc0-2e9c0feca923] Took 3.08 seconds to detach 3 volumes for instance.
Oct 20 14:35:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:20 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:35:20 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:35:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:20 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Deleted allocations for instance 122e112c-ed24-4206-bbc0-2e9c0feca923
Oct 20 14:35:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71452592-dc48-47b0-a5c6-2a81b7dcf86c tempest-TaggedBootDevicesTest_v242-413614803 tempest-TaggedBootDevicesTest_v242-413614803-project-member] Lock "122e112c-ed24-4206-bbc0-2e9c0feca923" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.436s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.volume.cinder [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Update attachment failed for attachment d5a6a877-9b7c-4e82-9c2c-3fc630e7db5e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9e55be13-ae61-45a3-a1e1-551cbf5b83cb) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9e55be13-ae61-45a3-a1e1-551cbf5b83cb)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9e55be13-ae61-45a3-a1e1-551cbf5b83cb)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Traceback (most recent call last):
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     yield
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     network_info = self._finish_resize(context, instance, migration,
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     self._update_volume_attachments(context, instance, bdms)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     self.volume_api.attachment_update(
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     res = method(self, ctx, *args, **kwargs)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     with excutils.save_and_reraise_exception():
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     self.force_reraise()
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     raise self.value
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     return method.func(obj, *args, **kwargs)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     return self.request(url, method, **kwargs)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc]     raise exceptions.from_response(resp, body)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9e55be13-ae61-45a3-a1e1-551cbf5b83cb)
Oct 20 14:35:22 user nova-compute[76870]: ERROR nova.compute.manager [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] 
Oct 20 14:35:23 user nova-compute[76870]: INFO nova.compute.manager [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Oct 20 14:35:23 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Deleted allocation for migration 8b67dc21-5e29-4456-9791-baffd97ae913
Oct 20 14:35:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:35:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:23 user nova-compute[76870]: INFO nova.compute.manager [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Successfully reverted task state from resize_finish on failure for instance.
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-1a966f2d-6595-4ab3-ae62-0b024dbb5df7 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9e55be13-ae61-45a3-a1e1-551cbf5b83cb)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6347, in finish_resize
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6344, in finish_resize
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9e55be13-ae61-45a3-a1e1-551cbf5b83cb)
Oct 20 14:35:23 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:35:25 user nova-compute[76870]: INFO nova.compute.manager [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] [instance: 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36] Took 7.68 seconds to detach 3 volumes for instance.
Oct 20 14:35:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:25 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:35:25 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:35:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:25 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Deleted allocations for instance 44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36
Oct 20 14:35:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-03e390dd-fff2-43ec-abc6-450cf70c6130 tempest-TaggedBootDevicesTest-1650508878 tempest-TaggedBootDevicesTest-1650508878-project-member] Lock "44e7533f-a63a-43ce-a3bb-6dbbfcdc4b36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.643s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:35:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:35:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:35:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updating instance_info_cache with network_info: [{"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-b8caf8f2-6533-4a01-b2fe-ce1899dff98d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:35:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:35:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:35:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:35:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8259MB free_disk=25.56998062133789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Applying migration context for instance a734d0c6-9dff-4254-9231-040de2c5eacc as it has an incoming, in-progress migration 8b67dc21-5e29-4456-9791-baffd97ae913. Migration status is error {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=76870) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 663ff166-5934-49b0-bb00-4600c1c31b08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a734d0c6-9dff-4254-9231-040de2c5eacc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:35:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:35:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:35:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:35:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:35:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:36:03 user nova-compute[76870]: INFO nova.compute.claims [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Claim successful on node user
Oct 20 14:36:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:36:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:36:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Creating image(s)
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.policy [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '859e78a4758a4cafa8e547e12126b1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99999331a734dc0b3cc9fcc517dfc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk 1073741824" returned: 0 in 0.054s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Cannot resize image /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Ensure instance console log exists: /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Successfully created port: 9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Successfully updated port: 9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-changed-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Refreshing instance network info cache due to event network-changed-9baeaf20-f156-4777-a8cf-c85722913a76. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance network_info: |[{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Refreshing network info cache for port 9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start _get_guest_xml network_info=[{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:36:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'pci_devices' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:36:06 user nova-compute[76870]:   <uuid>231934b4-7eee-443f-bbf4-6253e3e9705c</uuid>
Oct 20 14:36:06 user nova-compute[76870]:   <name>instance-0000000c</name>
Oct 20 14:36:06 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:36:06 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:36:06 user nova-compute[76870]:   <metadata>
Oct 20 14:36:06 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:36:06 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:36:06 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeTestJSON-server-573954456</nova:name>
Oct 20 14:36:06 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:36:06</nova:creationTime>
Oct 20 14:36:06 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:36:06 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:36:06 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:36:06 user nova-compute[76870]:       <nova:owner>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:user uuid="859e78a4758a4cafa8e547e12126b1e4">tempest-AttachVolumeTestJSON-345124704-project-member</nova:user>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:project uuid="d99999331a734dc0b3cc9fcc517dfc9a">tempest-AttachVolumeTestJSON-345124704</nova:project>
Oct 20 14:36:06 user nova-compute[76870]:       </nova:owner>
Oct 20 14:36:06 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:36:06 user nova-compute[76870]:       <nova:ports>
Oct 20 14:36:06 user nova-compute[76870]:         <nova:port uuid="9baeaf20-f156-4777-a8cf-c85722913a76">
Oct 20 14:36:06 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:36:06 user nova-compute[76870]:         </nova:port>
Oct 20 14:36:06 user nova-compute[76870]:       </nova:ports>
Oct 20 14:36:06 user nova-compute[76870]:     </nova:instance>
Oct 20 14:36:06 user nova-compute[76870]:   </metadata>
Oct 20 14:36:06 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:36:06 user nova-compute[76870]:     <system>
Oct 20 14:36:06 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:36:06 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:36:06 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:36:06 user nova-compute[76870]:       <entry name="serial">231934b4-7eee-443f-bbf4-6253e3e9705c</entry>
Oct 20 14:36:06 user nova-compute[76870]:       <entry name="uuid">231934b4-7eee-443f-bbf4-6253e3e9705c</entry>
Oct 20 14:36:06 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:36:06 user nova-compute[76870]:     </system>
Oct 20 14:36:06 user nova-compute[76870]:   </sysinfo>
Oct 20 14:36:06 user nova-compute[76870]:   <os>
Oct 20 14:36:06 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:36:06 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:36:06 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:36:06 user nova-compute[76870]:   </os>
Oct 20 14:36:06 user nova-compute[76870]:   <features>
Oct 20 14:36:06 user nova-compute[76870]:     <acpi/>
Oct 20 14:36:06 user nova-compute[76870]:     <apic/>
Oct 20 14:36:06 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:36:06 user nova-compute[76870]:   </features>
Oct 20 14:36:06 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:36:06 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:36:06 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:36:06 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:36:06 user nova-compute[76870]:   </clock>
Oct 20 14:36:06 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:36:06 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:36:06 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:36:06 user nova-compute[76870]:   </cpu>
Oct 20 14:36:06 user nova-compute[76870]:   <devices>
Oct 20 14:36:06 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:36:06 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:36:06 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk"/>
Oct 20 14:36:06 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:36:06 user nova-compute[76870]:     </disk>
Oct 20 14:36:06 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:36:06 user nova-compute[76870]:       <mac address="fa:16:3e:1f:2b:34"/>
Oct 20 14:36:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:36:06 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:36:06 user nova-compute[76870]:       <target dev="tap9baeaf20-f1"/>
Oct 20 14:36:06 user nova-compute[76870]:     </interface>
Oct 20 14:36:06 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:36:06 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/console.log" append="off"/>
Oct 20 14:36:06 user nova-compute[76870]:     </serial>
Oct 20 14:36:06 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:36:06 user nova-compute[76870]:     <video>
Oct 20 14:36:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:36:06 user nova-compute[76870]:     </video>
Oct 20 14:36:06 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:36:06 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:36:06 user nova-compute[76870]:     </rng>
Oct 20 14:36:06 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:36:06 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:36:06 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:36:06 user nova-compute[76870]:     </memballoon>
Oct 20 14:36:06 user nova-compute[76870]:   </devices>
Oct 20 14:36:06 user nova-compute[76870]: </domain>
Oct 20 14:36:06 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG os_vif [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c31edbd-9249-5ed1-b6d1-4bc267a69642', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9baeaf20-f1, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9baeaf20-f1, col_values=(('qos', UUID('c449ef33-4f03-457e-80c6-e5eced03691c')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9baeaf20-f1, col_values=(('external_ids', {'iface-id': '9baeaf20-f156-4777-a8cf-c85722913a76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2b:34', 'vm-uuid': '231934b4-7eee-443f-bbf4-6253e3e9705c'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:06 user nova-compute[76870]: INFO os_vif [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1')
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:36:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No VIF found with MAC fa:16:3e:1f:2b:34, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:36:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updated VIF entry in instance network info cache for port 9baeaf20-f156-4777-a8cf-c85722913a76. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:36:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-299e3998-e703-47af-9ae1-416ed4932f26 req-10a5de28-4df6-48e0-b36b-798750d6d4ff service nova] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-6b2452b2-4b51-4197-b3e5-7d925a9a7bf3 req-6d8b75fd-1621-4e9d-af4a-b245cc328a61 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6b2452b2-4b51-4197-b3e5-7d925a9a7bf3 req-6d8b75fd-1621-4e9d-af4a-b245cc328a61 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6b2452b2-4b51-4197-b3e5-7d925a9a7bf3 req-6d8b75fd-1621-4e9d-af4a-b245cc328a61 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6b2452b2-4b51-4197-b3e5-7d925a9a7bf3 req-6d8b75fd-1621-4e9d-af4a-b245cc328a61 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-6b2452b2-4b51-4197-b3e5-7d925a9a7bf3 req-6d8b75fd-1621-4e9d-af4a-b245cc328a61 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:36:08 user nova-compute[76870]: WARNING nova.compute.manager [req-6b2452b2-4b51-4197-b3e5-7d925a9a7bf3 req-6d8b75fd-1621-4e9d-af4a-b245cc328a61 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state building and task_state spawning.
Oct 20 14:36:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:36:10 user nova-compute[76870]: INFO nova.compute.claims [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Claim successful on node user
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-64bf414e-d57b-4642-9d9b-62c273403e66 req-56ccb9b1-861c-4a9d-b57f-6adb0366cbf1 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-64bf414e-d57b-4642-9d9b-62c273403e66 req-56ccb9b1-861c-4a9d-b57f-6adb0366cbf1 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-64bf414e-d57b-4642-9d9b-62c273403e66 req-56ccb9b1-861c-4a9d-b57f-6adb0366cbf1 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-64bf414e-d57b-4642-9d9b-62c273403e66 req-56ccb9b1-861c-4a9d-b57f-6adb0366cbf1 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-64bf414e-d57b-4642-9d9b-62c273403e66 req-56ccb9b1-861c-4a9d-b57f-6adb0366cbf1 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:36:10 user nova-compute[76870]: WARNING nova.compute.manager [req-64bf414e-d57b-4642-9d9b-62c273403e66 req-56ccb9b1-861c-4a9d-b57f-6adb0366cbf1 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state building and task_state spawning.
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:36:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance spawned successfully.
Oct 20 14:36:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:11 user nova-compute[76870]: INFO nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Took 6.95 seconds to spawn the instance on the hypervisor.
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:36:11 user nova-compute[76870]: INFO nova.compute.manager [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Took 7.84 seconds to build instance.
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-92669140-98e7-4747-8dda-66e6199efb94 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.962s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:36:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.policy [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f25d5591b5774753b836d3a0e6397166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f772f1ee2134d1b99bec5ac66ffe495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:36:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Creating image(s)
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "/opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "/opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.241s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk 1073741824" returned: 0 in 0.049s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Successfully created port: b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.234s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Cannot resize image /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Ensure instance console log exists: /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Successfully updated port: b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "refresh_cache-5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquired lock "refresh_cache-5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-changed-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Refreshing instance network info cache due to event network-changed-b47d9a84-dbae-4daa-8c8e-15dabbccd144. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] Acquiring lock "refresh_cache-5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Updating instance_info_cache with network_info: [{"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Releasing lock "refresh_cache-5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Instance network_info: |[{"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] Acquired lock "refresh_cache-5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Refreshing network info cache for port b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Start _get_guest_xml network_info=[{"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:36:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-709980580',display_name='tempest-VolumesAdminNegativeTest-server-709980580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-709980580',id=13,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f772f1ee2134d1b99bec5ac66ffe495',ramdisk_id='',reservation_id='r-dwqggrvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1322350658',owner_user_name='tempest-VolumesAdminNegativeTest-1322350658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:11Z,user_data=None,user_id='f25d5591b5774753b836d3a0e6397166',uuid=5f6e664b-cf7d-4393-9f25-bd06bdc75c1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converting VIF {"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:36:13 user nova-compute[76870]:   <uuid>5f6e664b-cf7d-4393-9f25-bd06bdc75c1a</uuid>
Oct 20 14:36:13 user nova-compute[76870]:   <name>instance-0000000d</name>
Oct 20 14:36:13 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:36:13 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:36:13 user nova-compute[76870]:   <metadata>
Oct 20 14:36:13 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:36:13 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:36:13 user nova-compute[76870]:       <nova:name>tempest-VolumesAdminNegativeTest-server-709980580</nova:name>
Oct 20 14:36:13 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:36:13</nova:creationTime>
Oct 20 14:36:13 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:36:13 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:36:13 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:36:13 user nova-compute[76870]:       <nova:owner>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:user uuid="f25d5591b5774753b836d3a0e6397166">tempest-VolumesAdminNegativeTest-1322350658-project-member</nova:user>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:project uuid="9f772f1ee2134d1b99bec5ac66ffe495">tempest-VolumesAdminNegativeTest-1322350658</nova:project>
Oct 20 14:36:13 user nova-compute[76870]:       </nova:owner>
Oct 20 14:36:13 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:36:13 user nova-compute[76870]:       <nova:ports>
Oct 20 14:36:13 user nova-compute[76870]:         <nova:port uuid="b47d9a84-dbae-4daa-8c8e-15dabbccd144">
Oct 20 14:36:13 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:36:13 user nova-compute[76870]:         </nova:port>
Oct 20 14:36:13 user nova-compute[76870]:       </nova:ports>
Oct 20 14:36:13 user nova-compute[76870]:     </nova:instance>
Oct 20 14:36:13 user nova-compute[76870]:   </metadata>
Oct 20 14:36:13 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:36:13 user nova-compute[76870]:     <system>
Oct 20 14:36:13 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:36:13 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:36:13 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:36:13 user nova-compute[76870]:       <entry name="serial">5f6e664b-cf7d-4393-9f25-bd06bdc75c1a</entry>
Oct 20 14:36:13 user nova-compute[76870]:       <entry name="uuid">5f6e664b-cf7d-4393-9f25-bd06bdc75c1a</entry>
Oct 20 14:36:13 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:36:13 user nova-compute[76870]:     </system>
Oct 20 14:36:13 user nova-compute[76870]:   </sysinfo>
Oct 20 14:36:13 user nova-compute[76870]:   <os>
Oct 20 14:36:13 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:36:13 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:36:13 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:36:13 user nova-compute[76870]:   </os>
Oct 20 14:36:13 user nova-compute[76870]:   <features>
Oct 20 14:36:13 user nova-compute[76870]:     <acpi/>
Oct 20 14:36:13 user nova-compute[76870]:     <apic/>
Oct 20 14:36:13 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:36:13 user nova-compute[76870]:   </features>
Oct 20 14:36:13 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:36:13 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:36:13 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:36:13 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:36:13 user nova-compute[76870]:   </clock>
Oct 20 14:36:13 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:36:13 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:36:13 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:36:13 user nova-compute[76870]:   </cpu>
Oct 20 14:36:13 user nova-compute[76870]:   <devices>
Oct 20 14:36:13 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:36:13 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:36:13 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk"/>
Oct 20 14:36:13 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:36:13 user nova-compute[76870]:     </disk>
Oct 20 14:36:13 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:36:13 user nova-compute[76870]:       <mac address="fa:16:3e:d3:b7:7b"/>
Oct 20 14:36:13 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:36:13 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:36:13 user nova-compute[76870]:       <target dev="tapb47d9a84-db"/>
Oct 20 14:36:13 user nova-compute[76870]:     </interface>
Oct 20 14:36:13 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:36:13 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/console.log" append="off"/>
Oct 20 14:36:13 user nova-compute[76870]:     </serial>
Oct 20 14:36:13 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:36:13 user nova-compute[76870]:     <video>
Oct 20 14:36:13 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:36:13 user nova-compute[76870]:     </video>
Oct 20 14:36:13 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:36:13 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:36:13 user nova-compute[76870]:     </rng>
Oct 20 14:36:13 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:36:13 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:36:13 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:36:13 user nova-compute[76870]:     </memballoon>
Oct 20 14:36:13 user nova-compute[76870]:   </devices>
Oct 20 14:36:13 user nova-compute[76870]: </domain>
Oct 20 14:36:13 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-709980580',display_name='tempest-VolumesAdminNegativeTest-server-709980580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-709980580',id=13,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f772f1ee2134d1b99bec5ac66ffe495',ramdisk_id='',reservation_id='r-dwqggrvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1322350658',owner_user_name='tempest-VolumesAdminNegativeTest-1322350658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:11Z,user_data=None,user_id='f25d5591b5774753b836d3a0e6397166',uuid=5f6e664b-cf7d-4393-9f25-bd06bdc75c1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converting VIF {"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG os_vif [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '948b65ef-66fb-5088-9560-5c6f04c121f3', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb47d9a84-db, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb47d9a84-db, col_values=(('qos', UUID('5a213638-0aaf-410a-b4f9-29c458069a3c')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb47d9a84-db, col_values=(('external_ids', {'iface-id': 'b47d9a84-dbae-4daa-8c8e-15dabbccd144', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:b7:7b', 'vm-uuid': '5f6e664b-cf7d-4393-9f25-bd06bdc75c1a'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: INFO os_vif [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db')
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] No VIF found with MAC fa:16:3e:d3:b7:7b, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Updated VIF entry in instance network info cache for port b47d9a84-dbae-4daa-8c8e-15dabbccd144. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Updating instance_info_cache with network_info: [{"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-32ae7008-9413-4571-9b6e-52e4c54e0143 req-3cb5964f-27b7-47c2-bd88-3dc188a91783 service nova] Releasing lock "refresh_cache-5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-68cc3824-de35-487b-9a68-2700623c3f37 req-da7656de-5031-40ad-a550-d68a955a80bc service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68cc3824-de35-487b-9a68-2700623c3f37 req-da7656de-5031-40ad-a550-d68a955a80bc service nova] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68cc3824-de35-487b-9a68-2700623c3f37 req-da7656de-5031-40ad-a550-d68a955a80bc service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68cc3824-de35-487b-9a68-2700623c3f37 req-da7656de-5031-40ad-a550-d68a955a80bc service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-68cc3824-de35-487b-9a68-2700623c3f37 req-da7656de-5031-40ad-a550-d68a955a80bc service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] No waiting events found dispatching network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:36:15 user nova-compute[76870]: WARNING nova.compute.manager [req-68cc3824-de35-487b-9a68-2700623c3f37 req-da7656de-5031-40ad-a550-d68a955a80bc service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received unexpected event network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 for instance with vm_state building and task_state spawning.
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-a5c63b4c-5d50-492a-aed3-203c7c6d7057 req-b8d4b517-39e5-49eb-a85c-e779ebe3cfbd service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a5c63b4c-5d50-492a-aed3-203c7c6d7057 req-b8d4b517-39e5-49eb-a85c-e779ebe3cfbd service nova] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a5c63b4c-5d50-492a-aed3-203c7c6d7057 req-b8d4b517-39e5-49eb-a85c-e779ebe3cfbd service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a5c63b4c-5d50-492a-aed3-203c7c6d7057 req-b8d4b517-39e5-49eb-a85c-e779ebe3cfbd service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-a5c63b4c-5d50-492a-aed3-203c7c6d7057 req-b8d4b517-39e5-49eb-a85c-e779ebe3cfbd service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] No waiting events found dispatching network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:36:17 user nova-compute[76870]: WARNING nova.compute.manager [req-a5c63b4c-5d50-492a-aed3-203c7c6d7057 req-b8d4b517-39e5-49eb-a85c-e779ebe3cfbd service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received unexpected event network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 for instance with vm_state building and task_state spawning.
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:36:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Instance spawned successfully.
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:36:17 user nova-compute[76870]: INFO nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Took 6.23 seconds to spawn the instance on the hypervisor.
Oct 20 14:36:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:36:17 user nova-compute[76870]: INFO nova.compute.manager [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Took 7.07 seconds to build instance.
Oct 20 14:36:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0b322c5-cebe-42c7-8b8f-b8841477115c tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.233s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'flavor' on Instance uuid 663ff166-5934-49b0-bb00-4600c1c31b08 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-changed-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Refreshing instance network info cache due to event network-changed-a013c6d2-9a71-4087-be3d-e3f42d0ee608. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] Acquiring lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] Acquired lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG nova.network.neutron [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Refreshing network info cache for port a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:19 user nova-compute[76870]: INFO nova.compute.manager [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Attaching volume 61b55d67-ffb9-4238-bea4-ed3129730953 to /dev/vdb
Oct 20 14:36:19 user nova-compute[76870]: DEBUG os_brick.utils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80469115-5d71-476e-896c-353f541d1955]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da77057-1004-48dc-922d-addf49b3c17d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0226111-6f21-4d2f-a704-d01fbb9e9e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a474fa-d628-43fb-8739-3c5de0b48ad2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:36:19 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:36:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df116c4-afde-428b-9e05-0f360be33597]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG os_brick.utils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:36:19 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating existing volume attachment record: 5671e378-7e3a-49b1-902e-e268d554ad72 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:36:20 user nova-compute[76870]: DEBUG nova.network.neutron [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updated VIF entry in instance network info cache for port a013c6d2-9a71-4087-be3d-e3f42d0ee608. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:36:20 user nova-compute[76870]: DEBUG nova.network.neutron [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d2cca2d4-5600-4b0d-a8a3-962e633b38b3 req-93700629-152c-4d92-9d93-049d3be81879 service nova] Releasing lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 14:36:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 14:36:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 0 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 14:36:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:24 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:36:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:28 user nova-compute[76870]: WARNING nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid a734d0c6-9dff-4254-9231-040de2c5eacc {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid d03d6cc9-1e71-49a9-aaae-f1ec46254200 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 663ff166-5934-49b0-bb00-4600c1c31b08 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 92d2469d-6ab3-446e-be34-6a657448fc25 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "92d2469d-6ab3-446e-be34-6a657448fc25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:28 user nova-compute[76870]: INFO nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (4). Updating power_state in the DB to match the hypervisor.
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: INFO nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:36:28 user nova-compute[76870]: WARNING nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance is unexpectedly not found. Ignore.
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "92d2469d-6ab3-446e-be34-6a657448fc25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.174s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.184s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:28 user nova-compute[76870]: INFO nova.compute.manager [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Terminating instance
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:36:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance destroyed successfully.
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lazy-loading 'resources' on Instance uuid a734d0c6-9dff-4254-9231-040de2c5eacc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-421716088',display_name='tempest-ServerActionsTestOtherB-server-421716088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-421716088',id=1,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5J1bkU05EsA9oLI2fFKX8jeghB7OrfieDYZJWE7wot0V9HQuQJYNbZk0BZfAsp4fuH8lc38ZICaToK7lrfRSosV9s8NqH/c8C3FaEjKVHZC1H80U+qw7HizpqyaPVw2g==',key_name='tempest-keypair-1128736685',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29ff7a7bc4204024a9e126a78a8c45bb',ramdisk_id='',reservation_id='r-8yrn360w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1628594369',owner_user_name='tempest-ServerActionsTestOtherB-1628594369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:35:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37fcf98d035d4ed8a6de3a15e78d3318',uuid=a734d0c6-9dff-4254-9231-040de2c5eacc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converting VIF {"id": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "address": "fa:16:3e:c8:d2:ab", "network": {"id": "16db35ab-1851-41c9-a3e2-e6c0ecd58b03", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1839464605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ff7a7bc4204024a9e126a78a8c45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cefc7-71", "ovs_interfaceid": "a15cefc7-71b8-4c86-bf3d-ab69e98d6914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG os_vif [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa15cefc7-71, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:36:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:28 user nova-compute[76870]: INFO os_vif [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914,network=Network(16db35ab-1851-41c9-a3e2-e6c0ecd58b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cefc7-71')
Oct 20 14:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPMaChbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:36:29 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e922072-f06b-43a0-ac80-e2cea9d097bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:36:29 user nova-compute[76870]: No targets found.
Oct 20 14:36:29 user nova-compute[76870]: iSNS:
Oct 20 14:36:29 user nova-compute[76870]: No targets found.
Oct 20 14:36:29 user nova-compute[76870]: STATIC:
Oct 20 14:36:29 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:36:29 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:36:29 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:36:29 user nova-compute[76870]: FIRMWARE:
Oct 20 14:36:29 user nova-compute[76870]: No targets found.
Oct 20 14:36:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:36:29 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:36:29 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e49792e-f3ee-4ce7-9665-d8215f308c45', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4421a7ef-c5c3-4a61-b4c6-2d806f84bcf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d19316-c2d0-4c7e-a08f-ec6ae0a6bf78]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8454af0>, {}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Disconnecting from: [] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] <== disconnect_volume: return (86ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:36:29 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deletion of /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize failed
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: INFO nova.compute.manager [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Took 0.34 seconds to destroy the instance on the hypervisor.
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:30 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Took 1.55 seconds to deallocate network for instance.
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-f837d943-1965-42fc-9031-eccd4e73878f req-fa4c57aa-5c08-4971-a1d0-17d571d8da60 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Received event network-vif-deleted-a15cefc7-71b8-4c86-bf3d-ab69e98d6914 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:30 user nova-compute[76870]: INFO nova.compute.manager [req-f837d943-1965-42fc-9031-eccd4e73878f req-fa4c57aa-5c08-4971-a1d0-17d571d8da60 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Neutron deleted interface a15cefc7-71b8-4c86-bf3d-ab69e98d6914; detaching it from the instance and deleting it from the info cache
Oct 20 14:36:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-f837d943-1965-42fc-9031-eccd4e73878f req-fa4c57aa-5c08-4971-a1d0-17d571d8da60 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:30 user nova-compute[76870]: INFO nova.compute.manager [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Took 0.10 seconds to detach 1 volumes for instance.
Oct 20 14:36:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-f837d943-1965-42fc-9031-eccd4e73878f req-fa4c57aa-5c08-4971-a1d0-17d571d8da60 service nova] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Detach interface failed, port_id=a15cefc7-71b8-4c86-bf3d-ab69e98d6914, reason: Instance a734d0c6-9dff-4254-9231-040de2c5eacc could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid 'a734d0c6-9dff-4254-9231-040de2c5eacc' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a734d0c6-9dff-4254-9231-040de2c5eacc' (instance-00000001)
Oct 20 14:36:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8071MB free_disk=25.527538299560547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.103s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.205s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:32 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Deleted allocations for instance a734d0c6-9dff-4254-9231-040de2c5eacc
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Applying migration context for instance a734d0c6-9dff-4254-9231-040de2c5eacc as it has an incoming, in-progress migration 8b67dc21-5e29-4456-9791-baffd97ae913. Migration status is error {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=76870) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 663ff166-5934-49b0-bb00-4600c1c31b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3da226f8-73e1-4d8a-aa60-73280f83fee0 tempest-ServerActionsTestOtherB-1628594369 tempest-ServerActionsTestOtherB-1628594369-project-member] Lock "a734d0c6-9dff-4254-9231-040de2c5eacc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.419s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:36:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:36:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:44 user nova-compute[76870]: INFO nova.compute.manager [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Detaching volume 09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:36:44 user nova-compute[76870]: INFO nova.virt.block_device [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Attempting to driver detach volume 09597554-9085-4f07-b262-2256a027aac8 from mountpoint /dev/vdb
Oct 20 14:36:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Attempting to detach device vdb from instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:36:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:36:44 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:36:44 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:36:44 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:36:44 user nova-compute[76870]:   <serial>09597554-9085-4f07-b262-2256a027aac8</serial>
Oct 20 14:36:44 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:36:44 user nova-compute[76870]: </disk>
Oct 20 14:36:44 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:36:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Successfully detached device vdb from instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d from the persistent domain config.
Oct 20 14:36:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:36:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:36:44 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:36:44 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:36:44 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:36:44 user nova-compute[76870]:   <serial>09597554-9085-4f07-b262-2256a027aac8</serial>
Oct 20 14:36:44 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:36:44 user nova-compute[76870]: </disk>
Oct 20 14:36:44 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:36:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:36:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VepuGQwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:36:49 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:36:49 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:36:49 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01ba696-ea7b-4163-8bea-d627fa86842d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:36:49 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a47fe07-8dca-4a21-b55c-cbd5ae26888d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953] added
Oct 20 14:36:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[89199d47-9096-4ad5-8721-478c30ec03c6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca11b6-0d60-4b23-bba1-7fc20846ab40]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VepuGQwP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VepuGQwP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ca1ed8-59a1-45aa-9df0-471e5b8af0fd]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VepuGQwP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[18660ccf-de82-48e9-b2b8-bb46086ccbac]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494d13d-5af0-437b-ae77-cf87aa805abe]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac9661-3bcd-4a18-a2d3-9a6e11b9376d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260]
Oct 20 14:36:49 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260] successful.
Oct 20 14:36:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a8f8d0-6ce3-4270-947f-727f3cd1f0e5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a95aa0-edf6-4088-8fd2-5d5bcb448f14]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 (non-flash)
Oct 20 14:36:49 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 (non-flash)
Oct 20 14:36:49 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:49 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[794c399f-4a41-4bd6-a56b-fe54da91bddb]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:36:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VepuGQwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:36:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:36:50 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23262323533343237', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:36:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262323533343237', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:36:50 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'flavor' on Instance uuid 663ff166-5934-49b0-bb00-4600c1c31b08 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:36:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:36:50 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:36:50 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:36:50 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:36:50 user nova-compute[76870]:   <serial>61b55d67-ffb9-4238-bea4-ed3129730953</serial>
Oct 20 14:36:50 user nova-compute[76870]: </disk>
Oct 20 14:36:50 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:36:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:36:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:36:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No VIF found with MAC fa:16:3e:47:0d:93, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:36:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f37bea56-2029-4a58-bc65-708883d7a70d tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.650s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 22.732s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:52 user nova-compute[76870]: INFO nova.compute.manager [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Rebuilding instance
Oct 20 14:36:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:36:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance destroyed successfully.
Oct 20 14:36:53 user nova-compute[76870]: INFO nova.compute.manager [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Detaching volume 61b55d67-ffb9-4238-bea4-ed3129730953
Oct 20 14:36:53 user nova-compute[76870]: INFO nova.virt.block_device [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Attempting to driver detach volume 61b55d67-ffb9-4238-bea4-ed3129730953 from mountpoint /dev/vdb
Oct 20 14:36:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Attempting to detach device vdb from instance 663ff166-5934-49b0-bb00-4600c1c31b08 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:36:53 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:36:53 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:36:53 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:36:53 user nova-compute[76870]:   <serial>61b55d67-ffb9-4238-bea4-ed3129730953</serial>
Oct 20 14:36:53 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:36:53 user nova-compute[76870]: </disk>
Oct 20 14:36:53 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully detached device vdb from instance 663ff166-5934-49b0-bb00-4600c1c31b08 from the persistent domain config.
Oct 20 14:36:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VepuGQwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:36:53 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 14:36:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[84184df3-10d7-4dae-9812-2e5ce085ead2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:36:53 user nova-compute[76870]: No targets found.
Oct 20 14:36:53 user nova-compute[76870]: iSNS:
Oct 20 14:36:53 user nova-compute[76870]: No targets found.
Oct 20 14:36:53 user nova-compute[76870]: STATIC:
Oct 20 14:36:53 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953
Oct 20 14:36:53 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:36:53 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:36:53 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:36:53 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:36:53 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:36:53 user nova-compute[76870]: FIRMWARE:
Oct 20 14:36:53 user nova-compute[76870]: No targets found.
Oct 20 14:36:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:36:53 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:36:53 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:36:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3aa168-9af2-4bef-bbb3-5be09d1393f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08599c7-51fb-4a87-87ea-c4fae9a5f887]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 (non-flash)
Oct 20 14:36:54 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 (non-flash)
Oct 20 14:36:54 user nova-compute[76870]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c4d79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a8bee-8e4b-40c9-90a4-db967cd23c47]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ffc306-00c5-4bfa-9de0-b3984309af6d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b277d59-d6b6-4f3f-b857-adbb0a2c4256]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac69273-ebe1-453e-9348-8065745b3d1b]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e284da96-1158-4a5a-92a3-99653e923c02]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:36:54 user nova-compute[76870]: INFO nova.compute.claims [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Claim successful on node user
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b693739-1fde-4056-8439-3884543a97cc]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260]
Oct 20 14:36:54 user nova-compute[76870]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953, portal: 172.16.0.220,3260] successful.
Oct 20 14:36:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d488a8-6ec4-43a0-863c-9bd8530a69ee]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== disconnect_volume: return (326ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:36:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.policy [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3094cfbcdd5148aba1d1ce26587df977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecc3c7784fb14a7ba60637eb343e4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:36:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Creating image(s)
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk 1073741824" returned: 0 in 0.228s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.438s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance destroyed successfully.
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1239079696',display_name='tempest-ServerActionsTestOtherA-server-33169401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1239079696',id=11,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtWduLiSPzp/VIWUKHUa6UtA2knbF4Q50olmDaUXr/g/hom82515E7C8B1Pp5lBk6XIf+Ts5MHmM2RjJ9FLsPEJfZPdRT6D+WICkm8NU+kt+pvIZmBiyTVuZYgnHIt+pg==',key_name='tempest-keypair-115946927',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-tas7lovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=663ff166-5934-49b0-bb00-4600c1c31b08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_vif [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa013c6d2-9a, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68dcb5a2-a92a-4a97-8b4e-2eaf83c54050) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:55 user nova-compute[76870]: INFO os_vif [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a')
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VepuGQwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:36:55 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[09070822-7f8a-41f3-813d-6ae2b22d3af9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:36:55 user nova-compute[76870]: No targets found.
Oct 20 14:36:55 user nova-compute[76870]: iSNS:
Oct 20 14:36:55 user nova-compute[76870]: No targets found.
Oct 20 14:36:55 user nova-compute[76870]: STATIC:
Oct 20 14:36:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:36:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:36:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:36:55 user nova-compute[76870]: FIRMWARE:
Oct 20 14:36:55 user nova-compute[76870]: No targets found.
Oct 20 14:36:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:36:55 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:36:55 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7452f7a7-2823-40b7-bf63-7751057dcf39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4d3701-c840-4d5c-b4db-5a07fbf0ade0]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:36:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf84495a0>, {}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Disconnecting from: [] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== disconnect_volume: return (74ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:36:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Deleting instance files /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08_del
Oct 20 14:36:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Deletion of /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08_del complete
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: INFO nova.virt.block_device [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Booting with volume 61b55d67-ffb9-4238-bea4-ed3129730953 at /dev/vdb
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Cannot resize image /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Ensure instance console log exists: /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG os_brick.utils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[124aa72f-3907-48fd-8df0-61aa2f096243]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1aaede-1dcd-4c47-a808-f6fc34b3a12f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea045b4-804f-4bd9-aea1-2d96171ecf93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c695fe1-8653-4acc-874c-65bbd775a2eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:36:56 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c7e638-6752-4386-8f99-a468f47edd81]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG os_brick.utils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating existing volume attachment record: 7a17899f-9672-4838-97d8-27ed16c68af7 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Successfully created port: 2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-d4fe7236-1484-4383-b2ed-a373fa3eb6ac req-26b00e77-ec15-4bdb-8f28-d7f5083eb47c service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-vif-unplugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d4fe7236-1484-4383-b2ed-a373fa3eb6ac req-26b00e77-ec15-4bdb-8f28-d7f5083eb47c service nova] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d4fe7236-1484-4383-b2ed-a373fa3eb6ac req-26b00e77-ec15-4bdb-8f28-d7f5083eb47c service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d4fe7236-1484-4383-b2ed-a373fa3eb6ac req-26b00e77-ec15-4bdb-8f28-d7f5083eb47c service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-d4fe7236-1484-4383-b2ed-a373fa3eb6ac req-26b00e77-ec15-4bdb-8f28-d7f5083eb47c service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] No waiting events found dispatching network-vif-unplugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:36:56 user nova-compute[76870]: WARNING nova.compute.manager [req-d4fe7236-1484-4383-b2ed-a373fa3eb6ac req-26b00e77-ec15-4bdb-8f28-d7f5083eb47c service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received unexpected event network-vif-unplugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 20 14:36:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Successfully updated port: 2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing instance network info cache due to event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:36:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance network_info: |[{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Start _get_guest_xml network_info=[{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:36:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1236982515',display_name='tempest-ServerStableDeviceRescueTest-server-1236982515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1236982515',id=14,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa0xAD6rR4ur738WniBVFOJTLLjE7g5xf7KHCpl9EPmGFrx5Hk1ZeGbLCrjJRKWZcWm9kpzqlnwXpFYGY4tVS0tLDzx2cUVYco6IszVAWtoNbTsCEGzgLT/dkGG3fXcPw==',key_name='tempest-keypair-114909760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecc3c7784fb14a7ba60637eb343e4536',ramdisk_id='',reservation_id='r-3ck0n3p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1598823131',owner_user_name='tempest-ServerStableDeviceRescueTest-1598823131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3094cfbcdd5148aba1d1ce26587df977',uuid=e51d3dd1-98b7-49ad-bacf-f76ae5961963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converting VIF {"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.objects.instance [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'pci_devices' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:36:58 user nova-compute[76870]:   <uuid>e51d3dd1-98b7-49ad-bacf-f76ae5961963</uuid>
Oct 20 14:36:58 user nova-compute[76870]:   <name>instance-0000000e</name>
Oct 20 14:36:58 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:36:58 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:36:58 user nova-compute[76870]:   <metadata>
Oct 20 14:36:58 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:36:58 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:36:58 user nova-compute[76870]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1236982515</nova:name>
Oct 20 14:36:58 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:36:58</nova:creationTime>
Oct 20 14:36:58 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:36:58 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:36:58 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:36:58 user nova-compute[76870]:       <nova:owner>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:user uuid="3094cfbcdd5148aba1d1ce26587df977">tempest-ServerStableDeviceRescueTest-1598823131-project-member</nova:user>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:project uuid="ecc3c7784fb14a7ba60637eb343e4536">tempest-ServerStableDeviceRescueTest-1598823131</nova:project>
Oct 20 14:36:58 user nova-compute[76870]:       </nova:owner>
Oct 20 14:36:58 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:36:58 user nova-compute[76870]:       <nova:ports>
Oct 20 14:36:58 user nova-compute[76870]:         <nova:port uuid="2b5df74b-2f39-43d5-8bfa-c56de7663d71">
Oct 20 14:36:58 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 14:36:58 user nova-compute[76870]:         </nova:port>
Oct 20 14:36:58 user nova-compute[76870]:       </nova:ports>
Oct 20 14:36:58 user nova-compute[76870]:     </nova:instance>
Oct 20 14:36:58 user nova-compute[76870]:   </metadata>
Oct 20 14:36:58 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:36:58 user nova-compute[76870]:     <system>
Oct 20 14:36:58 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:36:58 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:36:58 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:36:58 user nova-compute[76870]:       <entry name="serial">e51d3dd1-98b7-49ad-bacf-f76ae5961963</entry>
Oct 20 14:36:58 user nova-compute[76870]:       <entry name="uuid">e51d3dd1-98b7-49ad-bacf-f76ae5961963</entry>
Oct 20 14:36:58 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:36:58 user nova-compute[76870]:     </system>
Oct 20 14:36:58 user nova-compute[76870]:   </sysinfo>
Oct 20 14:36:58 user nova-compute[76870]:   <os>
Oct 20 14:36:58 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:36:58 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:36:58 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:36:58 user nova-compute[76870]:   </os>
Oct 20 14:36:58 user nova-compute[76870]:   <features>
Oct 20 14:36:58 user nova-compute[76870]:     <acpi/>
Oct 20 14:36:58 user nova-compute[76870]:     <apic/>
Oct 20 14:36:58 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:36:58 user nova-compute[76870]:   </features>
Oct 20 14:36:58 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:36:58 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:36:58 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:36:58 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:36:58 user nova-compute[76870]:   </clock>
Oct 20 14:36:58 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:36:58 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:36:58 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:36:58 user nova-compute[76870]:   </cpu>
Oct 20 14:36:58 user nova-compute[76870]:   <devices>
Oct 20 14:36:58 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:36:58 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:36:58 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk"/>
Oct 20 14:36:58 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:36:58 user nova-compute[76870]:     </disk>
Oct 20 14:36:58 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:36:58 user nova-compute[76870]:       <mac address="fa:16:3e:66:c7:68"/>
Oct 20 14:36:58 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:36:58 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:36:58 user nova-compute[76870]:       <target dev="tap2b5df74b-2f"/>
Oct 20 14:36:58 user nova-compute[76870]:     </interface>
Oct 20 14:36:58 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:36:58 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/console.log" append="off"/>
Oct 20 14:36:58 user nova-compute[76870]:     </serial>
Oct 20 14:36:58 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:36:58 user nova-compute[76870]:     <video>
Oct 20 14:36:58 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:36:58 user nova-compute[76870]:     </video>
Oct 20 14:36:58 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:36:58 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:36:58 user nova-compute[76870]:     </rng>
Oct 20 14:36:58 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:36:58 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:36:58 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:36:58 user nova-compute[76870]:     </memballoon>
Oct 20 14:36:58 user nova-compute[76870]:   </devices>
Oct 20 14:36:58 user nova-compute[76870]: </domain>
Oct 20 14:36:58 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1236982515',display_name='tempest-ServerStableDeviceRescueTest-server-1236982515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1236982515',id=14,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa0xAD6rR4ur738WniBVFOJTLLjE7g5xf7KHCpl9EPmGFrx5Hk1ZeGbLCrjJRKWZcWm9kpzqlnwXpFYGY4tVS0tLDzx2cUVYco6IszVAWtoNbTsCEGzgLT/dkGG3fXcPw==',key_name='tempest-keypair-114909760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecc3c7784fb14a7ba60637eb343e4536',ramdisk_id='',reservation_id='r-3ck0n3p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1598823131',owner_user_name='tempest-ServerStableDeviceRescueTest-1598823131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3094cfbcdd5148aba1d1ce26587df977',uuid=e51d3dd1-98b7-49ad-bacf-f76ae5961963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converting VIF {"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG os_vif [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49741000-43e1-5355-9e49-5eddf0ee8723', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b5df74b-2f, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b5df74b-2f, col_values=(('qos', UUID('c7826192-bcb1-4e7b-8bcd-e95142d949e0')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b5df74b-2f, col_values=(('external_ids', {'iface-id': '2b5df74b-2f39-43d5-8bfa-c56de7663d71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:c7:68', 'vm-uuid': 'e51d3dd1-98b7-49ad-bacf-f76ae5961963'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: INFO os_vif [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f')
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No VIF found with MAC fa:16:3e:66:c7:68, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-8387f9f0-7a9e-4d4e-a16f-d73773abb602 req-5631175d-2dc7-46da-bb95-a31a606c8f6c service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8387f9f0-7a9e-4d4e-a16f-d73773abb602 req-5631175d-2dc7-46da-bb95-a31a606c8f6c service nova] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8387f9f0-7a9e-4d4e-a16f-d73773abb602 req-5631175d-2dc7-46da-bb95-a31a606c8f6c service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8387f9f0-7a9e-4d4e-a16f-d73773abb602 req-5631175d-2dc7-46da-bb95-a31a606c8f6c service nova] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-8387f9f0-7a9e-4d4e-a16f-d73773abb602 req-5631175d-2dc7-46da-bb95-a31a606c8f6c service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] No waiting events found dispatching network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:36:58 user nova-compute[76870]: WARNING nova.compute.manager [req-8387f9f0-7a9e-4d4e-a16f-d73773abb602 req-5631175d-2dc7-46da-bb95-a31a606c8f6c service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received unexpected event network-vif-plugged-a013c6d2-9a71-4087-be3d-e3f42d0ee608 for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updated VIF entry in instance network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c7ebd52-aaa5-49e7-a400-ff03ba989f39 req-ad959fe5-f155-44da-ba53-192d0a301908 service nova] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:36:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:36:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-6fea725c-d2d8-48b0-b805-0fe0148a04e8 req-7c4a0988-bbf1-47fc-80a6-587983b6bfe1 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6fea725c-d2d8-48b0-b805-0fe0148a04e8 req-7c4a0988-bbf1-47fc-80a6-587983b6bfe1 service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6fea725c-d2d8-48b0-b805-0fe0148a04e8 req-7c4a0988-bbf1-47fc-80a6-587983b6bfe1 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6fea725c-d2d8-48b0-b805-0fe0148a04e8 req-7c4a0988-bbf1-47fc-80a6-587983b6bfe1 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-6fea725c-d2d8-48b0-b805-0fe0148a04e8 req-7c4a0988-bbf1-47fc-80a6-587983b6bfe1 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:00 user nova-compute[76870]: WARNING nova.compute.manager [req-6fea725c-d2d8-48b0-b805-0fe0148a04e8 req-7c4a0988-bbf1-47fc-80a6-587983b6bfe1 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state building and task_state spawning.
Oct 20 14:37:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:37:02 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance spawned successfully.
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:02 user nova-compute[76870]: INFO nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Took 7.60 seconds to spawn the instance on the hypervisor.
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:37:02 user nova-compute[76870]: INFO nova.compute.manager [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Took 8.48 seconds to build instance.
Oct 20 14:37:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0455939e-8179-4b19-9946-a15a329877a9 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.596s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-783d1d1e-8378-43a2-a8dc-a4e4fac862ef req-74bda8b4-4a58-4e0e-8a11-5b68a6562e8b service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-783d1d1e-8378-43a2-a8dc-a4e4fac862ef req-74bda8b4-4a58-4e0e-8a11-5b68a6562e8b service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-783d1d1e-8378-43a2-a8dc-a4e4fac862ef req-74bda8b4-4a58-4e0e-8a11-5b68a6562e8b service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-783d1d1e-8378-43a2-a8dc-a4e4fac862ef req-74bda8b4-4a58-4e0e-8a11-5b68a6562e8b service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-783d1d1e-8378-43a2-a8dc-a4e4fac862ef req-74bda8b4-4a58-4e0e-8a11-5b68a6562e8b service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:02 user nova-compute[76870]: WARNING nova.compute.manager [req-783d1d1e-8378-43a2-a8dc-a4e4fac862ef req-74bda8b4-4a58-4e0e-8a11-5b68a6562e8b service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state active and task_state None.
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:37:03 user nova-compute[76870]: INFO nova.compute.claims [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Claim successful on node user
Oct 20 14:37:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:37:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.policy [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d72e66a5d848abb44324278b94264c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada23dc3b7874d0786b6652e7d4113bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:37:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Creating image(s)
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "/opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "/opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "/opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.278s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.222s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk 1073741824" returned: 0 in 0.264s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.492s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:37:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Cannot resize image /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Ensure instance console log exists: /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Successfully created port: 5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:37:05 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d is timed out.
Oct 20 14:37:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Successfully detached device vdb from instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d from the live domain config.
Oct 20 14:37:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxfMwkG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:37:05 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a86670-7277-4283-afc8-90e8f2d236a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:37:05 user nova-compute[76870]: No targets found.
Oct 20 14:37:05 user nova-compute[76870]: iSNS:
Oct 20 14:37:05 user nova-compute[76870]: No targets found.
Oct 20 14:37:05 user nova-compute[76870]: STATIC:
Oct 20 14:37:05 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8
Oct 20 14:37:05 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:37:05 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:37:05 user nova-compute[76870]: FIRMWARE:
Oct 20 14:37:05 user nova-compute[76870]: No targets found.
Oct 20 14:37:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:37:05 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:37:05 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d856de9-2a22-4f86-9600-df97356b9219]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[09df3fba-1649-485d-9861-b013cb922554]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:37:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 (non-flash)
Oct 20 14:37:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8472170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac473395-ab0c-4633-ad05-8eeb4551b4ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2e0be7-5c48-4451-8aab-469804b4db22]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5856ee4b-2551-4629-8363-99805b83d59e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[896db268-f6ca-4630-b4ce-2b707a4ca698]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[562c224c-a520-4050-aa14-84d3da1b636c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fbee46-54bb-4847-af40-1ea505aea8b0]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260]
Oct 20 14:37:05 user nova-compute[76870]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8, portal: 172.16.0.220,3260] successful.
Oct 20 14:37:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09597554-9085-4f07-b262-2256a027aac8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c040dfd3-c8ed-4e7a-9ea6-ee5a3ee60d6e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] <== disconnect_volume: return (351ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:37:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Successfully updated port: 5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquired lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-changed-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Refreshing instance network info cache due to event network-changed-5faa1c32-b887-4eb1-a34a-5a920409c6ba. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] Acquiring lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updating instance_info_cache with network_info: [{"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Releasing lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Instance network_info: |[{"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] Acquired lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Refreshing network info cache for port 5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Start _get_guest_xml network_info=[{"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:37:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1043965414',display_name='tempest-TestServerVolumeAttachmentScenario-server-1043965414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1043965414',id=15,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFC5YoFnSxJ6V6M+OdgJ7KAeAd33RjxzHMMBgTInovus2KUd75Dg32S4i3IALclm+uD659c2HZJniZIXqGd+PcClGPbemdzMybr0W86F9cItZntRxIq5RseMlcPTmgllQ==',key_name='tempest-keypair-1266801638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ada23dc3b7874d0786b6652e7d4113bd',ramdisk_id='',reservation_id='r-9q0oeq69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1748983472',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1748983472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d72e66a5d848abb44324278b94264c',uuid=74ef247a-85bb-4a23-a5f4-f2579122c131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Converting VIF {"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'pci_devices' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:37:06 user nova-compute[76870]:   <uuid>74ef247a-85bb-4a23-a5f4-f2579122c131</uuid>
Oct 20 14:37:06 user nova-compute[76870]:   <name>instance-0000000f</name>
Oct 20 14:37:06 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:37:06 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:37:06 user nova-compute[76870]:   <metadata>
Oct 20 14:37:06 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:37:06 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:37:06 user nova-compute[76870]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1043965414</nova:name>
Oct 20 14:37:06 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:37:06</nova:creationTime>
Oct 20 14:37:06 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:37:06 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:37:06 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:37:06 user nova-compute[76870]:       <nova:owner>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:user uuid="82d72e66a5d848abb44324278b94264c">tempest-TestServerVolumeAttachmentScenario-1748983472-project-member</nova:user>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:project uuid="ada23dc3b7874d0786b6652e7d4113bd">tempest-TestServerVolumeAttachmentScenario-1748983472</nova:project>
Oct 20 14:37:06 user nova-compute[76870]:       </nova:owner>
Oct 20 14:37:06 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:37:06 user nova-compute[76870]:       <nova:ports>
Oct 20 14:37:06 user nova-compute[76870]:         <nova:port uuid="5faa1c32-b887-4eb1-a34a-5a920409c6ba">
Oct 20 14:37:06 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 14:37:06 user nova-compute[76870]:         </nova:port>
Oct 20 14:37:06 user nova-compute[76870]:       </nova:ports>
Oct 20 14:37:06 user nova-compute[76870]:     </nova:instance>
Oct 20 14:37:06 user nova-compute[76870]:   </metadata>
Oct 20 14:37:06 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:37:06 user nova-compute[76870]:     <system>
Oct 20 14:37:06 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:37:06 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:37:06 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:37:06 user nova-compute[76870]:       <entry name="serial">74ef247a-85bb-4a23-a5f4-f2579122c131</entry>
Oct 20 14:37:06 user nova-compute[76870]:       <entry name="uuid">74ef247a-85bb-4a23-a5f4-f2579122c131</entry>
Oct 20 14:37:06 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:37:06 user nova-compute[76870]:     </system>
Oct 20 14:37:06 user nova-compute[76870]:   </sysinfo>
Oct 20 14:37:06 user nova-compute[76870]:   <os>
Oct 20 14:37:06 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:37:06 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:37:06 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:37:06 user nova-compute[76870]:   </os>
Oct 20 14:37:06 user nova-compute[76870]:   <features>
Oct 20 14:37:06 user nova-compute[76870]:     <acpi/>
Oct 20 14:37:06 user nova-compute[76870]:     <apic/>
Oct 20 14:37:06 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:37:06 user nova-compute[76870]:   </features>
Oct 20 14:37:06 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:37:06 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:37:06 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:37:06 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:37:06 user nova-compute[76870]:   </clock>
Oct 20 14:37:06 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:37:06 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:37:06 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:37:06 user nova-compute[76870]:   </cpu>
Oct 20 14:37:06 user nova-compute[76870]:   <devices>
Oct 20 14:37:06 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:37:06 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:37:06 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk"/>
Oct 20 14:37:06 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:37:06 user nova-compute[76870]:     </disk>
Oct 20 14:37:06 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:37:06 user nova-compute[76870]:       <mac address="fa:16:3e:37:9f:c8"/>
Oct 20 14:37:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:37:06 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:37:06 user nova-compute[76870]:       <target dev="tap5faa1c32-b8"/>
Oct 20 14:37:06 user nova-compute[76870]:     </interface>
Oct 20 14:37:06 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:37:06 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/console.log" append="off"/>
Oct 20 14:37:06 user nova-compute[76870]:     </serial>
Oct 20 14:37:06 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:37:06 user nova-compute[76870]:     <video>
Oct 20 14:37:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:37:06 user nova-compute[76870]:     </video>
Oct 20 14:37:06 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:37:06 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:37:06 user nova-compute[76870]:     </rng>
Oct 20 14:37:06 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:37:06 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:37:06 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:37:06 user nova-compute[76870]:     </memballoon>
Oct 20 14:37:06 user nova-compute[76870]:   </devices>
Oct 20 14:37:06 user nova-compute[76870]: </domain>
Oct 20 14:37:06 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1043965414',display_name='tempest-TestServerVolumeAttachmentScenario-server-1043965414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1043965414',id=15,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFC5YoFnSxJ6V6M+OdgJ7KAeAd33RjxzHMMBgTInovus2KUd75Dg32S4i3IALclm+uD659c2HZJniZIXqGd+PcClGPbemdzMybr0W86F9cItZntRxIq5RseMlcPTmgllQ==',key_name='tempest-keypair-1266801638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ada23dc3b7874d0786b6652e7d4113bd',ramdisk_id='',reservation_id='r-9q0oeq69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1748983472',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1748983472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d72e66a5d848abb44324278b94264c',uuid=74ef247a-85bb-4a23-a5f4-f2579122c131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Converting VIF {"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG os_vif [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b85ff2ff-5533-5f60-be88-b6fecada74aa', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5faa1c32-b8, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5faa1c32-b8, col_values=(('qos', UUID('40415ae8-42ad-4e8d-b915-16c16881c289')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5faa1c32-b8, col_values=(('external_ids', {'iface-id': '5faa1c32-b887-4eb1-a34a-5a920409c6ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:9f:c8', 'vm-uuid': '74ef247a-85bb-4a23-a5f4-f2579122c131'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:06 user nova-compute[76870]: INFO os_vif [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8')
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:37:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No VIF found with MAC fa:16:3e:37:9f:c8, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:37:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updated VIF entry in instance network info cache for port 5faa1c32-b887-4eb1-a34a-5a920409c6ba. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:37:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updating instance_info_cache with network_info: [{"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cb529bcb-3671-41da-b00a-adeebf733aee req-3ad40791-5dba-4fb2-b418-7cb684d24c54 service nova] Releasing lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-c2a1c455-b0df-4f8a-8ecc-82c05dd37d26 req-37238cac-bec6-4b67-aadd-bc190394957a service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c2a1c455-b0df-4f8a-8ecc-82c05dd37d26 req-37238cac-bec6-4b67-aadd-bc190394957a service nova] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c2a1c455-b0df-4f8a-8ecc-82c05dd37d26 req-37238cac-bec6-4b67-aadd-bc190394957a service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c2a1c455-b0df-4f8a-8ecc-82c05dd37d26 req-37238cac-bec6-4b67-aadd-bc190394957a service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-c2a1c455-b0df-4f8a-8ecc-82c05dd37d26 req-37238cac-bec6-4b67-aadd-bc190394957a service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] No waiting events found dispatching network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:08 user nova-compute[76870]: WARNING nova.compute.manager [req-c2a1c455-b0df-4f8a-8ecc-82c05dd37d26 req-37238cac-bec6-4b67-aadd-bc190394957a service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received unexpected event network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba for instance with vm_state building and task_state spawning.
Oct 20 14:37:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:09 user nova-compute[76870]: DEBUG nova.objects.instance [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lazy-loading 'flavor' on Instance uuid b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:37:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42ced145-99dd-430a-933d-51bb23692763 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.912s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.volume.cinder [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Update attachment failed for attachment 7a17899f-9672-4838-97d8-27ed16c68af7. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Traceback (most recent call last):
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self.driver.rebuild(**kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise NotImplementedError()
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] NotImplementedError
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] During handling of the above exception, another exception occurred:
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Traceback (most recent call last):
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     driver_block_device.attach_block_devices(
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     _log_and_attach(device)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     bdm.attach(*attach_args, **attach_kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._volume_attach(context, volume, connector, instance,
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     connection_info = volume_api.attachment_update(
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     res = method(self, ctx, *args, **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     with excutils.save_and_reraise_exception():
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self.force_reraise()
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise self.value
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     return method.func(obj, *args, **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     return self.request(url, method, **kwargs)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise exceptions.from_response(resp, body)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:09 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.compute.utils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd) {{(pid=76870) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Traceback (most recent call last):
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self.driver.rebuild(**kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise NotImplementedError()
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] NotImplementedError
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] During handling of the above exception, another exception occurred:
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Traceback (most recent call last):
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     driver_block_device.attach_block_devices(
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     _log_and_attach(device)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     bdm.attach(*attach_args, **attach_kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._volume_attach(context, volume, connector, instance,
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     connection_info = volume_api.attachment_update(
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     res = method(self, ctx, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     with excutils.save_and_reraise_exception():
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self.force_reraise()
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise self.value
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     return method.func(obj, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     return self.request(url, method, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise exceptions.from_response(resp, body)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] During handling of the above exception, another exception occurred:
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Traceback (most recent call last):
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     yield
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._do_rebuild_instance_with_claim(
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._do_rebuild_instance(
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     self._rebuild_default_impl(**kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     new_block_device_info = attach_block_devices(context, instance, bdms)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08]     raise exception.InvalidBDM(str(ex))
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:10 user nova-compute[76870]: ERROR nova.compute.manager [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] 
Oct 20 14:37:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:10 user nova-compute[76870]: INFO nova.compute.manager [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-a3e8efd4-2b69-407f-948b-c6fab7aa500a tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server NotImplementedError
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b2c8b63-118c-46d8-bc2a-8496b28579cd)
Oct 20 14:37:10 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-a11e5ce9-3a15-4bf2-a993-04fc1c67e81b req-10d25195-e6e3-4629-9e1c-fd3ce5046250 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a11e5ce9-3a15-4bf2-a993-04fc1c67e81b req-10d25195-e6e3-4629-9e1c-fd3ce5046250 service nova] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a11e5ce9-3a15-4bf2-a993-04fc1c67e81b req-10d25195-e6e3-4629-9e1c-fd3ce5046250 service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a11e5ce9-3a15-4bf2-a993-04fc1c67e81b req-10d25195-e6e3-4629-9e1c-fd3ce5046250 service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-a11e5ce9-3a15-4bf2-a993-04fc1c67e81b req-10d25195-e6e3-4629-9e1c-fd3ce5046250 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] No waiting events found dispatching network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:10 user nova-compute[76870]: WARNING nova.compute.manager [req-a11e5ce9-3a15-4bf2-a993-04fc1c67e81b req-10d25195-e6e3-4629-9e1c-fd3ce5046250 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received unexpected event network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba for instance with vm_state building and task_state spawning.
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:37:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Instance spawned successfully.
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:10 user nova-compute[76870]: INFO nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Took 7.06 seconds to spawn the instance on the hypervisor.
Oct 20 14:37:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:37:11 user nova-compute[76870]: INFO nova.compute.manager [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Took 8.09 seconds to build instance.
Oct 20 14:37:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0c5dff31-9341-44eb-8c86-4e419d9c2cdb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.240s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:37:18 user nova-compute[76870]: INFO nova.compute.claims [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Claim successful on node user
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:37:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.policy [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9efb8ffb0f7f47f1ab587820e0f72c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3077015e86bc441e8a6622b6af839537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:37:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Creating image(s)
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "/opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.209s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk 1073741824" returned: 0 in 0.069s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Successfully created port: 8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.221s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Cannot resize image /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Ensure instance console log exists: /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Successfully updated port: 8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquired lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-changed-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Refreshing instance network info cache due to event network-changed-8eb60e76-707f-4c6b-b0fd-6de87abbc432. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] Acquiring lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updating instance_info_cache with network_info: [{"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Releasing lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Instance network_info: |[{"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] Acquired lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.neutron [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Refreshing network info cache for port 8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Start _get_guest_xml network_info=[{"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:37:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-865937556',display_name='tempest-AttachVolumeNegativeTest-server-865937556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-865937556',id=16,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDpSTPNExYdLepONW6sPR4JlJOOrVasD5hp48/p4K6pLWLB8EzHXq6jkbWNIuOyvV/pUanwFWRKthlQRPrM4ZBDL867vNwVLSEyijBkUl/wXzZolvGnfUWmQMIrRnTk4g==',key_name='tempest-keypair-187291426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-sou7ippw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=c298bfea-a5c5-44a4-a4fd-508f199f46a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'pci_devices' on Instance uuid c298bfea-a5c5-44a4-a4fd-508f199f46a7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:37:20 user nova-compute[76870]:   <uuid>c298bfea-a5c5-44a4-a4fd-508f199f46a7</uuid>
Oct 20 14:37:20 user nova-compute[76870]:   <name>instance-00000010</name>
Oct 20 14:37:20 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:37:20 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:37:20 user nova-compute[76870]:   <metadata>
Oct 20 14:37:20 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:37:20 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:37:20 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-865937556</nova:name>
Oct 20 14:37:20 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:37:20</nova:creationTime>
Oct 20 14:37:20 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:37:20 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:37:20 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:37:20 user nova-compute[76870]:       <nova:owner>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:user uuid="9efb8ffb0f7f47f1ab587820e0f72c91">tempest-AttachVolumeNegativeTest-742706560-project-member</nova:user>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:project uuid="3077015e86bc441e8a6622b6af839537">tempest-AttachVolumeNegativeTest-742706560</nova:project>
Oct 20 14:37:20 user nova-compute[76870]:       </nova:owner>
Oct 20 14:37:20 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:37:20 user nova-compute[76870]:       <nova:ports>
Oct 20 14:37:20 user nova-compute[76870]:         <nova:port uuid="8eb60e76-707f-4c6b-b0fd-6de87abbc432">
Oct 20 14:37:20 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 14:37:20 user nova-compute[76870]:         </nova:port>
Oct 20 14:37:20 user nova-compute[76870]:       </nova:ports>
Oct 20 14:37:20 user nova-compute[76870]:     </nova:instance>
Oct 20 14:37:20 user nova-compute[76870]:   </metadata>
Oct 20 14:37:20 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:37:20 user nova-compute[76870]:     <system>
Oct 20 14:37:20 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:37:20 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:37:20 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:37:20 user nova-compute[76870]:       <entry name="serial">c298bfea-a5c5-44a4-a4fd-508f199f46a7</entry>
Oct 20 14:37:20 user nova-compute[76870]:       <entry name="uuid">c298bfea-a5c5-44a4-a4fd-508f199f46a7</entry>
Oct 20 14:37:20 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:37:20 user nova-compute[76870]:     </system>
Oct 20 14:37:20 user nova-compute[76870]:   </sysinfo>
Oct 20 14:37:20 user nova-compute[76870]:   <os>
Oct 20 14:37:20 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:37:20 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:37:20 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:37:20 user nova-compute[76870]:   </os>
Oct 20 14:37:20 user nova-compute[76870]:   <features>
Oct 20 14:37:20 user nova-compute[76870]:     <acpi/>
Oct 20 14:37:20 user nova-compute[76870]:     <apic/>
Oct 20 14:37:20 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:37:20 user nova-compute[76870]:   </features>
Oct 20 14:37:20 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:37:20 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:37:20 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:37:20 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:37:20 user nova-compute[76870]:   </clock>
Oct 20 14:37:20 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:37:20 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:37:20 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:37:20 user nova-compute[76870]:   </cpu>
Oct 20 14:37:20 user nova-compute[76870]:   <devices>
Oct 20 14:37:20 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:37:20 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:37:20 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk"/>
Oct 20 14:37:20 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:37:20 user nova-compute[76870]:     </disk>
Oct 20 14:37:20 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:37:20 user nova-compute[76870]:       <mac address="fa:16:3e:5d:f5:6e"/>
Oct 20 14:37:20 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:37:20 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:37:20 user nova-compute[76870]:       <target dev="tap8eb60e76-70"/>
Oct 20 14:37:20 user nova-compute[76870]:     </interface>
Oct 20 14:37:20 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:37:20 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/console.log" append="off"/>
Oct 20 14:37:20 user nova-compute[76870]:     </serial>
Oct 20 14:37:20 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:37:20 user nova-compute[76870]:     <video>
Oct 20 14:37:20 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:37:20 user nova-compute[76870]:     </video>
Oct 20 14:37:20 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:37:20 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:37:20 user nova-compute[76870]:     </rng>
Oct 20 14:37:20 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:37:20 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:37:20 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:37:20 user nova-compute[76870]:     </memballoon>
Oct 20 14:37:20 user nova-compute[76870]:   </devices>
Oct 20 14:37:20 user nova-compute[76870]: </domain>
Oct 20 14:37:20 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-865937556',display_name='tempest-AttachVolumeNegativeTest-server-865937556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-865937556',id=16,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDpSTPNExYdLepONW6sPR4JlJOOrVasD5hp48/p4K6pLWLB8EzHXq6jkbWNIuOyvV/pUanwFWRKthlQRPrM4ZBDL867vNwVLSEyijBkUl/wXzZolvGnfUWmQMIrRnTk4g==',key_name='tempest-keypair-187291426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-sou7ippw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=c298bfea-a5c5-44a4-a4fd-508f199f46a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG os_vif [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a57743c-28f2-5c89-9116-9f7bbabf9257', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eb60e76-70, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eb60e76-70, col_values=(('qos', UUID('57399c7b-6c4f-4e85-97c6-887203b128ee')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eb60e76-70, col_values=(('external_ids', {'iface-id': '8eb60e76-707f-4c6b-b0fd-6de87abbc432', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:f5:6e', 'vm-uuid': 'c298bfea-a5c5-44a4-a4fd-508f199f46a7'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:20 user nova-compute[76870]: INFO os_vif [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70')
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:37:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:5d:f5:6e, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:37:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updated VIF entry in instance network info cache for port 8eb60e76-707f-4c6b-b0fd-6de87abbc432. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:37:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updating instance_info_cache with network_info: [{"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9837046a-1d83-41a9-8c4a-a6b71e9d5074 req-df18d523-cfea-4405-9531-8b1a2b2fa80c service nova] Releasing lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-a063886a-92e9-4ea2-b000-1480f642b150 req-687e67bd-c04e-44b7-8235-f2f70edbc821 service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a063886a-92e9-4ea2-b000-1480f642b150 req-687e67bd-c04e-44b7-8235-f2f70edbc821 service nova] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a063886a-92e9-4ea2-b000-1480f642b150 req-687e67bd-c04e-44b7-8235-f2f70edbc821 service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a063886a-92e9-4ea2-b000-1480f642b150 req-687e67bd-c04e-44b7-8235-f2f70edbc821 service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-a063886a-92e9-4ea2-b000-1480f642b150 req-687e67bd-c04e-44b7-8235-f2f70edbc821 service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] No waiting events found dispatching network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:22 user nova-compute[76870]: WARNING nova.compute.manager [req-a063886a-92e9-4ea2-b000-1480f642b150 req-687e67bd-c04e-44b7-8235-f2f70edbc821 service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received unexpected event network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 for instance with vm_state building and task_state spawning.
Oct 20 14:37:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-27cd7727-7be7-4e31-aaf4-b60190a2f4e5 req-a495b44d-5c03-4ad5-a2d8-f6505dbaaa4f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27cd7727-7be7-4e31-aaf4-b60190a2f4e5 req-a495b44d-5c03-4ad5-a2d8-f6505dbaaa4f service nova] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27cd7727-7be7-4e31-aaf4-b60190a2f4e5 req-a495b44d-5c03-4ad5-a2d8-f6505dbaaa4f service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-27cd7727-7be7-4e31-aaf4-b60190a2f4e5 req-a495b44d-5c03-4ad5-a2d8-f6505dbaaa4f service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-27cd7727-7be7-4e31-aaf4-b60190a2f4e5 req-a495b44d-5c03-4ad5-a2d8-f6505dbaaa4f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] No waiting events found dispatching network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:24 user nova-compute[76870]: WARNING nova.compute.manager [req-27cd7727-7be7-4e31-aaf4-b60190a2f4e5 req-a495b44d-5c03-4ad5-a2d8-f6505dbaaa4f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received unexpected event network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 for instance with vm_state building and task_state spawning.
Oct 20 14:37:24 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:37:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:37:24 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Instance spawned successfully.
Oct 20 14:37:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:25 user nova-compute[76870]: INFO nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:37:25 user nova-compute[76870]: INFO nova.compute.manager [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Took 7.01 seconds to build instance.
Oct 20 14:37:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3596cc9c-5bd6-4fac-b067-b953f879b6f5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.128s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:37:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:37:29 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:34 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:34 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=25.454299926757812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 74ef247a-85bb-4a23-a5f4-f2579122c131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:37:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:35 user nova-compute[76870]: INFO nova.compute.manager [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Terminating instance
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1996772-4737-49d0-874f-d16056d73497 req-76d097fd-8a20-453d-a657-c70d0f5ec16a service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-vif-unplugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1996772-4737-49d0-874f-d16056d73497 req-76d097fd-8a20-453d-a657-c70d0f5ec16a service nova] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1996772-4737-49d0-874f-d16056d73497 req-76d097fd-8a20-453d-a657-c70d0f5ec16a service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1996772-4737-49d0-874f-d16056d73497 req-76d097fd-8a20-453d-a657-c70d0f5ec16a service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1996772-4737-49d0-874f-d16056d73497 req-76d097fd-8a20-453d-a657-c70d0f5ec16a service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] No waiting events found dispatching network-vif-unplugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1996772-4737-49d0-874f-d16056d73497 req-76d097fd-8a20-453d-a657-c70d0f5ec16a service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-vif-unplugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Instance destroyed successfully.
Oct 20 14:37:36 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lazy-loading 'resources' on Instance uuid b8caf8f2-6533-4a01-b2fe-ce1899dff98d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1907430451',display_name='tempest-TestVolumeSwap-server-1907430451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1907430451',id=6,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsDP/L6Ur4MDQdJ8knCLX6wMFUwXdQkkWIJrougBAXv4LF7yOyT6OiSBp312OLQJ2MGd87HlUnbHKWaaelZUNnnR9IsnLshpOlxRM6ToOFiidCdvqOOGn+qfm4Ofn4BhQ==',key_name='tempest-keypair-1354219287',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:31:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d384a2bb004716871df6ec84d5b42c',ramdisk_id='',reservation_id='r-cmp97say',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1936833443',owner_user_name='tempest-TestVolumeSwap-1936833443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db0c5c37a67348e685ea17e285950d28',uuid=b8caf8f2-6533-4a01-b2fe-ce1899dff98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Converting VIF {"id": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "address": "fa:16:3e:22:d2:84", "network": {"id": "72cc8ec5-8725-4477-9d04-50d1c10a51c2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-999900199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d384a2bb004716871df6ec84d5b42c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48d0946-3b", "ovs_interfaceid": "f48d0946-3b64-46f8-93ae-5e7fafa9f0f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG os_vif [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf48d0946-3b, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feb9b774-ca80-4d06-87ac-5c95ec8395f7) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:36 user nova-compute[76870]: INFO os_vif [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=f48d0946-3b64-46f8-93ae-5e7fafa9f0f4,network=Network(72cc8ec5-8725-4477-9d04-50d1c10a51c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48d0946-3b')
Oct 20 14:37:36 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Deleting instance files /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d_del
Oct 20 14:37:36 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Deletion of /opt/stack/data/nova/instances/b8caf8f2-6533-4a01-b2fe-ce1899dff98d_del complete
Oct 20 14:37:36 user nova-compute[76870]: INFO nova.compute.manager [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 14:37:36 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:37:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:37 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Took 1.11 seconds to deallocate network for instance.
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] Acquiring lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] No waiting events found dispatching network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:37 user nova-compute[76870]: WARNING nova.compute.manager [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received unexpected event network-vif-plugged-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 for instance with vm_state deleted and task_state None.
Oct 20 14:37:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-e35e7ba9-32ca-454b-bd44-ea693ba5d443 req-65c20a79-eee7-4c04-9d72-296ec9784b60 service nova] [instance: b8caf8f2-6533-4a01-b2fe-ce1899dff98d] Received event network-vif-deleted-f48d0946-3b64-46f8-93ae-5e7fafa9f0f4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:37 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Deleted allocations for instance b8caf8f2-6533-4a01-b2fe-ce1899dff98d
Oct 20 14:37:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a37fc567-46fd-4ee0-a77b-955edf8e07c6 tempest-TestVolumeSwap-1936833443 tempest-TestVolumeSwap-1936833443-project-member] Lock "b8caf8f2-6533-4a01-b2fe-ce1899dff98d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:37:45 user nova-compute[76870]: INFO nova.compute.claims [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Claim successful on node user
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:37:45 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:37:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG nova.policy [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a358910175f646c39bb6d7e12ed5334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3670195fbec411c891e3ea8820b01d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:37:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Creating image(s)
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk 1073741824" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Successfully created port: 01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.270s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:37:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Cannot resize image /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Ensure instance console log exists: /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Successfully updated port: 01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing instance network info cache due to event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance network_info: |[{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Start _get_guest_xml network_info=[{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:37:47 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:47 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1740794095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1740794095',id=17,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Vht16OCN4sPyGhaf3+hnoNK9immod4cIIJ6znYvCe10mAAb2RHE6Ol3iH8L1oRDb8RL/6sW6PkS7xWx8SYu0ITeMg4JYKTSo+f6rozBLPuvZFuZ+c/OkeliQuvQzK9A==',key_name='tempest-keypair-737388622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-if0prmy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=844f56f6-be92-4c0b-88a9-55a82b330646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'pci_devices' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:37:47 user nova-compute[76870]:   <uuid>844f56f6-be92-4c0b-88a9-55a82b330646</uuid>
Oct 20 14:37:47 user nova-compute[76870]:   <name>instance-00000011</name>
Oct 20 14:37:47 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:37:47 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:37:47 user nova-compute[76870]:   <metadata>
Oct 20 14:37:47 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:37:47 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:37:47 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1740794095</nova:name>
Oct 20 14:37:47 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:37:47</nova:creationTime>
Oct 20 14:37:47 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:37:47 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:37:47 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:37:47 user nova-compute[76870]:       <nova:owner>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:user uuid="a358910175f646c39bb6d7e12ed5334e">tempest-AttachVolumeShelveTestJSON-801976804-project-member</nova:user>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:project uuid="b3670195fbec411c891e3ea8820b01d1">tempest-AttachVolumeShelveTestJSON-801976804</nova:project>
Oct 20 14:37:47 user nova-compute[76870]:       </nova:owner>
Oct 20 14:37:47 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:37:47 user nova-compute[76870]:       <nova:ports>
Oct 20 14:37:47 user nova-compute[76870]:         <nova:port uuid="01c77894-1f28-4395-81e2-ca97beaf0d5c">
Oct 20 14:37:47 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 14:37:47 user nova-compute[76870]:         </nova:port>
Oct 20 14:37:47 user nova-compute[76870]:       </nova:ports>
Oct 20 14:37:47 user nova-compute[76870]:     </nova:instance>
Oct 20 14:37:47 user nova-compute[76870]:   </metadata>
Oct 20 14:37:47 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:37:47 user nova-compute[76870]:     <system>
Oct 20 14:37:47 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:37:47 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:37:47 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:37:47 user nova-compute[76870]:       <entry name="serial">844f56f6-be92-4c0b-88a9-55a82b330646</entry>
Oct 20 14:37:47 user nova-compute[76870]:       <entry name="uuid">844f56f6-be92-4c0b-88a9-55a82b330646</entry>
Oct 20 14:37:47 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:37:47 user nova-compute[76870]:     </system>
Oct 20 14:37:47 user nova-compute[76870]:   </sysinfo>
Oct 20 14:37:47 user nova-compute[76870]:   <os>
Oct 20 14:37:47 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:37:47 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:37:47 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:37:47 user nova-compute[76870]:   </os>
Oct 20 14:37:47 user nova-compute[76870]:   <features>
Oct 20 14:37:47 user nova-compute[76870]:     <acpi/>
Oct 20 14:37:47 user nova-compute[76870]:     <apic/>
Oct 20 14:37:47 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:37:47 user nova-compute[76870]:   </features>
Oct 20 14:37:47 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:37:47 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:37:47 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:37:47 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:37:47 user nova-compute[76870]:   </clock>
Oct 20 14:37:47 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:37:47 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:37:47 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:37:47 user nova-compute[76870]:   </cpu>
Oct 20 14:37:47 user nova-compute[76870]:   <devices>
Oct 20 14:37:47 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:37:47 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:37:47 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk"/>
Oct 20 14:37:47 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:37:47 user nova-compute[76870]:     </disk>
Oct 20 14:37:47 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:37:47 user nova-compute[76870]:       <mac address="fa:16:3e:c1:da:15"/>
Oct 20 14:37:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:37:47 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:37:47 user nova-compute[76870]:       <target dev="tap01c77894-1f"/>
Oct 20 14:37:47 user nova-compute[76870]:     </interface>
Oct 20 14:37:47 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:37:47 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/console.log" append="off"/>
Oct 20 14:37:47 user nova-compute[76870]:     </serial>
Oct 20 14:37:47 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:37:47 user nova-compute[76870]:     <video>
Oct 20 14:37:47 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:37:47 user nova-compute[76870]:     </video>
Oct 20 14:37:47 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:37:47 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:37:47 user nova-compute[76870]:     </rng>
Oct 20 14:37:47 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:37:47 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:37:47 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:37:47 user nova-compute[76870]:     </memballoon>
Oct 20 14:37:47 user nova-compute[76870]:   </devices>
Oct 20 14:37:47 user nova-compute[76870]: </domain>
Oct 20 14:37:47 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1740794095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1740794095',id=17,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Vht16OCN4sPyGhaf3+hnoNK9immod4cIIJ6znYvCe10mAAb2RHE6Ol3iH8L1oRDb8RL/6sW6PkS7xWx8SYu0ITeMg4JYKTSo+f6rozBLPuvZFuZ+c/OkeliQuvQzK9A==',key_name='tempest-keypair-737388622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-if0prmy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=844f56f6-be92-4c0b-88a9-55a82b330646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG os_vif [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0768f3ed-9741-54ec-8d31-2358903fea16', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01c77894-1f, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01c77894-1f, col_values=(('qos', UUID('4c494957-0489-483e-a8ac-2cbd385a841a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01c77894-1f, col_values=(('external_ids', {'iface-id': '01c77894-1f28-4395-81e2-ca97beaf0d5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:da:15', 'vm-uuid': '844f56f6-be92-4c0b-88a9-55a82b330646'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:47 user nova-compute[76870]: INFO os_vif [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f')
Oct 20 14:37:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:37:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No VIF found with MAC fa:16:3e:c1:da:15, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:37:48 user nova-compute[76870]: DEBUG nova.network.neutron [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updated VIF entry in instance network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:37:48 user nova-compute[76870]: DEBUG nova.network.neutron [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7cfdc3cf-7164-47b1-9b69-17f920264410 req-0eb316e0-eb3a-4026-973c-69d01dcab6c9 service nova] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-79876b53-d577-4876-9d0e-3e6f745c2c4d req-95564f4d-599b-4195-a1e5-4f649c7e6b19 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-79876b53-d577-4876-9d0e-3e6f745c2c4d req-95564f4d-599b-4195-a1e5-4f649c7e6b19 service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-79876b53-d577-4876-9d0e-3e6f745c2c4d req-95564f4d-599b-4195-a1e5-4f649c7e6b19 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-79876b53-d577-4876-9d0e-3e6f745c2c4d req-95564f4d-599b-4195-a1e5-4f649c7e6b19 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-79876b53-d577-4876-9d0e-3e6f745c2c4d req-95564f4d-599b-4195-a1e5-4f649c7e6b19 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:49 user nova-compute[76870]: WARNING nova.compute.manager [req-79876b53-d577-4876-9d0e-3e6f745c2c4d req-95564f4d-599b-4195-a1e5-4f649c7e6b19 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state building and task_state spawning.
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:37:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance spawned successfully.
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-10ddb0eb-570b-45d9-8ffd-6e678d711cc4 req-4c3d8155-5fc4-463b-86b8-9b100e1d4115 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-10ddb0eb-570b-45d9-8ffd-6e678d711cc4 req-4c3d8155-5fc4-463b-86b8-9b100e1d4115 service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-10ddb0eb-570b-45d9-8ffd-6e678d711cc4 req-4c3d8155-5fc4-463b-86b8-9b100e1d4115 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-10ddb0eb-570b-45d9-8ffd-6e678d711cc4 req-4c3d8155-5fc4-463b-86b8-9b100e1d4115 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-10ddb0eb-570b-45d9-8ffd-6e678d711cc4 req-4c3d8155-5fc4-463b-86b8-9b100e1d4115 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:37:51 user nova-compute[76870]: WARNING nova.compute.manager [req-10ddb0eb-570b-45d9-8ffd-6e678d711cc4 req-4c3d8155-5fc4-463b-86b8-9b100e1d4115 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state building and task_state spawning.
Oct 20 14:37:51 user nova-compute[76870]: INFO nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Took 5.57 seconds to spawn the instance on the hypervisor.
Oct 20 14:37:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:37:51 user nova-compute[76870]: INFO nova.compute.manager [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Took 6.42 seconds to build instance.
Oct 20 14:37:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d4fd16a-1bf1-4ebc-b2a4-b6fa310e5b2b tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.525s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:37:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-changed-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:37:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Refreshing instance network info cache due to event network-changed-9baeaf20-f156-4777-a8cf-c85722913a76. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:37:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:37:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:37:54 user nova-compute[76870]: DEBUG nova.network.neutron [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Refreshing network info cache for port 9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:37:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updated VIF entry in instance network info cache for port 9baeaf20-f156-4777-a8cf-c85722913a76. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:37:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:37:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-909e9d5f-bdd9-4a91-8fca-4bcb315c9605 req-8ef48880-61aa-4eb3-a44d-14b3a1724bd5 service nova] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:37:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG nova.objects.instance [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:01 user nova-compute[76870]: INFO nova.compute.manager [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Attaching volume 419b0aa2-eba3-4e57-9fa3-ffc55b2da441 to /dev/vdb
Oct 20 14:38:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214c5d3-fe75-4922-b012-44ecfe528962]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0841562-096c-4176-b217-30d6b5d22c52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba587f7-df38-4c96-8a6f-62739bedd575]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c3287-0f5e-4074-815c-9b5bc922c17b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:38:01 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:38:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd7411-2959-4e07-9444-2bcd6dea7128]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:38:01 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating existing volume attachment record: a3de10d9-7e00-4d88-895a-914da07d45a5 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:38:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:17 user nova-compute[76870]: INFO nova.compute.manager [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Terminating instance
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-45e79460-b80e-4fee-8940-32dfd94b129a req-0009a025-0de1-41ae-a328-f4f6a3b690f9 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-vif-unplugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-45e79460-b80e-4fee-8940-32dfd94b129a req-0009a025-0de1-41ae-a328-f4f6a3b690f9 service nova] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-45e79460-b80e-4fee-8940-32dfd94b129a req-0009a025-0de1-41ae-a328-f4f6a3b690f9 service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-45e79460-b80e-4fee-8940-32dfd94b129a req-0009a025-0de1-41ae-a328-f4f6a3b690f9 service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-45e79460-b80e-4fee-8940-32dfd94b129a req-0009a025-0de1-41ae-a328-f4f6a3b690f9 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] No waiting events found dispatching network-vif-unplugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-45e79460-b80e-4fee-8940-32dfd94b129a req-0009a025-0de1-41ae-a328-f4f6a3b690f9 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-vif-unplugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Instance destroyed successfully.
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.objects.instance [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lazy-loading 'resources' on Instance uuid 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-709980580',display_name='tempest-VolumesAdminNegativeTest-server-709980580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-709980580',id=13,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f772f1ee2134d1b99bec5ac66ffe495',ramdisk_id='',reservation_id='r-dwqggrvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1322350658',owner_user_name='tempest-VolumesAdminNegativeTest-1322350658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:36:18Z,user_data=None,user_id='f25d5591b5774753b836d3a0e6397166',uuid=5f6e664b-cf7d-4393-9f25-bd06bdc75c1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converting VIF {"id": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "address": "fa:16:3e:d3:b7:7b", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47d9a84-db", "ovs_interfaceid": "b47d9a84-dbae-4daa-8c8e-15dabbccd144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG os_vif [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb47d9a84-db, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a213638-0aaf-410a-b4f9-29c458069a3c) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:17 user nova-compute[76870]: INFO os_vif [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b7:7b,bridge_name='br-int',has_traffic_filtering=True,id=b47d9a84-dbae-4daa-8c8e-15dabbccd144,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47d9a84-db')
Oct 20 14:38:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Deleting instance files /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a_del
Oct 20 14:38:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Deletion of /opt/stack/data/nova/instances/5f6e664b-cf7d-4393-9f25-bd06bdc75c1a_del complete
Oct 20 14:38:18 user nova-compute[76870]: INFO nova.compute.manager [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 14:38:18 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:38:18 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:38:18 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:38:18 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:38:18 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Took 0.54 seconds to deallocate network for instance.
Oct 20 14:38:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:18 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:38:18 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:19 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Deleted allocations for instance 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-353a4ab6-3443-48ef-beb2-20256a1dc92f tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] Acquiring lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] Lock "5f6e664b-cf7d-4393-9f25-bd06bdc75c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] No waiting events found dispatching network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:38:19 user nova-compute[76870]: WARNING nova.compute.manager [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received unexpected event network-vif-plugged-b47d9a84-dbae-4daa-8c8e-15dabbccd144 for instance with vm_state deleted and task_state None.
Oct 20 14:38:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a1ae7ef-4b0b-4d0d-8078-5fd4c82e24ac req-0a71091c-c4a6-42ec-ac01-54a808f3c880 service nova] [instance: 5f6e664b-cf7d-4393-9f25-bd06bdc75c1a] Received event network-vif-deleted-b47d9a84-dbae-4daa-8c8e-15dabbccd144 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:38:19 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:38:19 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:38:19 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa8cd0-5dc9-494f-8a04-fd473f5b0456]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:38:19 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b55af1-0b1a-4a6c-bae4-976935deac0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441] added
Oct 20 14:38:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[556f952e-6f75-45af-9d2f-c05ac9bb4ffd]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40f7442-5c83-460f-a379-7ece2876c438]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgzZbTBH {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgzZbTBH" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3841e60-78c6-4eb7-b575-30845e4c4cb8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CgzZbTBH'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[940bb72d-0d1a-4297-96a6-2b9c7675142c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47af750-490b-45f2-b8d8-4d873c33fab8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:38:20 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:38:20 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:38:20 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 14:38:20 user nova-compute[76870]: 
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1555b9b6-4cd1-4d2e-a780-d7a802295a81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]
Oct 20 14:38:20 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.
Oct 20 14:38:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c24e52-8f4e-44d9-b79e-b7c0108946ae]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444d0c4-3f89-40ea-bef0-1d43f4f0fd5f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:38:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:38:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca31059-fee9-4aeb-815c-efcc5ab4ea2f]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:38:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26435363538346138', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435363538346138', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG nova.objects.instance [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:38:21 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:38:21 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:38:21 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:38:21 user nova-compute[76870]:   <serial>419b0aa2-eba3-4e57-9fa3-ffc55b2da441</serial>
Oct 20 14:38:21 user nova-compute[76870]: </disk>
Oct 20 14:38:21 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No VIF found with MAC fa:16:3e:1f:2b:34, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:38:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-858fa314-be26-4231-b678-3375538b2c4c tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.589s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76870) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG nova.objects.instance [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-f2c02ebc-d0fd-4916-9d8c-41de18a040e4 req-4fd4eb93-13b6-4884-8a2c-f3dd515ee672 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f2c02ebc-d0fd-4916-9d8c-41de18a040e4 req-4fd4eb93-13b6-4884-8a2c-f3dd515ee672 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f2c02ebc-d0fd-4916-9d8c-41de18a040e4 req-4fd4eb93-13b6-4884-8a2c-f3dd515ee672 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f2c02ebc-d0fd-4916-9d8c-41de18a040e4 req-4fd4eb93-13b6-4884-8a2c-f3dd515ee672 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-f2c02ebc-d0fd-4916-9d8c-41de18a040e4 req-4fd4eb93-13b6-4884-8a2c-f3dd515ee672 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:38:22 user nova-compute[76870]: WARNING nova.compute.manager [req-f2c02ebc-d0fd-4916-9d8c-41de18a040e4 req-4fd4eb93-13b6-4884-8a2c-f3dd515ee672 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state active and task_state powering-off.
Oct 20 14:38:22 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance destroyed successfully.
Oct 20 14:38:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:38:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ef5799a-2d1f-4d66-bc4e-c0f89c4f0fe9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.019s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-f92c20a5-aeb5-459b-a81f-b6f9b3d5ba13 req-c547e27a-f603-4a77-9885-5a95a5e98645 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f92c20a5-aeb5-459b-a81f-b6f9b3d5ba13 req-c547e27a-f603-4a77-9885-5a95a5e98645 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f92c20a5-aeb5-459b-a81f-b6f9b3d5ba13 req-c547e27a-f603-4a77-9885-5a95a5e98645 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f92c20a5-aeb5-459b-a81f-b6f9b3d5ba13 req-c547e27a-f603-4a77-9885-5a95a5e98645 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-f92c20a5-aeb5-459b-a81f-b6f9b3d5ba13 req-c547e27a-f603-4a77-9885-5a95a5e98645 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:38:24 user nova-compute[76870]: WARNING nova.compute.manager [req-f92c20a5-aeb5-459b-a81f-b6f9b3d5ba13 req-c547e27a-f603-4a77-9885-5a95a5e98645 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state stopped and task_state None.
Oct 20 14:38:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:38:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:38:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:38:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:38:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=25.42184066772461GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d03d6cc9-1e71-49a9-aaae-f1ec46254200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 74ef247a-85bb-4a23-a5f4-f2579122c131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 844f56f6-be92-4c0b-88a9-55a82b330646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:38:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:38:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:38:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:38:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:38:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating instance_info_cache with network_info: [{"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:38:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d03d6cc9-1e71-49a9-aaae-f1ec46254200" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:38:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:38:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing instance network info cache due to event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updated VIF entry in instance network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG nova.network.neutron [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:38:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-440131b7-2547-4df9-881f-c2039156b678 req-99f056af-9d74-4d71-99a7-26b4c8c7931d service nova] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:38:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:38:46 user nova-compute[76870]: INFO nova.compute.manager [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] instance snapshotting
Oct 20 14:38:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Beginning live snapshot process
Oct 20 14:38:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0hgv8ojx/287ac8ff1bf04cdcad124b31574d2672.delta 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0hgv8ojx/287ac8ff1bf04cdcad124b31574d2672.delta 1073741824" returned: 0 in 0.098s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 14:38:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 14:38:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 14:38:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 14:38:48 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:38:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0hgv8ojx/287ac8ff1bf04cdcad124b31574d2672.delta /opt/stack/data/nova/instances/snapshots/tmp0hgv8ojx/287ac8ff1bf04cdcad124b31574d2672 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0hgv8ojx/287ac8ff1bf04cdcad124b31574d2672.delta /opt/stack/data/nova/instances/snapshots/tmp0hgv8ojx/287ac8ff1bf04cdcad124b31574d2672" returned: 0 in 0.409s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Snapshot extracted, beginning image upload
Oct 20 14:38:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Snapshot image upload complete
Oct 20 14:38:51 user nova-compute[76870]: INFO nova.compute.manager [None req-fbf9d560-0ee3-4f4e-b913-2cbeb8ea3edb tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Took 5.32 seconds to snapshot the instance on the hypervisor.
Oct 20 14:38:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-changed-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:38:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Refreshing instance network info cache due to event network-changed-5faa1c32-b887-4eb1-a34a-5a920409c6ba. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:38:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] Acquiring lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:38:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] Acquired lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:38:53 user nova-compute[76870]: DEBUG nova.network.neutron [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Refreshing network info cache for port 5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG nova.network.neutron [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updated VIF entry in instance network info cache for port 5faa1c32-b887-4eb1-a34a-5a920409c6ba. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG nova.network.neutron [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updating instance_info_cache with network_info: [{"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5c830e68-8c06-48a7-8c34-84eb6e5d6144 req-535f290c-9de8-4884-adf1-19cd52750927 service nova] Releasing lock "refresh_cache-74ef247a-85bb-4a23-a5f4-f2579122c131" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'flavor' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:38:54 user nova-compute[76870]: INFO nova.compute.manager [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attaching volume e93d285c-bd08-4535-9859-d5466bd5981e to /dev/vdb
Oct 20 14:38:54 user nova-compute[76870]: DEBUG os_brick.utils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b93c47d-1d16-485a-8c09-dde5e01cc3a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59efe1-e5c9-4c26-8c0b-069dbb76a92c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f6f7b2-937f-4471-a177-6f736663b291]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[13154564-aded-4a4e-8f88-6be2a329bd0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:38:54 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:38:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a9a030-a346-46ec-9274-0c53cfd223bb]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG os_brick.utils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:38:54 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updating existing volume attachment record: 44bd3cb7-ac36-4bb7-a88d-61d7bf09f9c9 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:38:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:39:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:39:02 user nova-compute[76870]: INFO nova.compute.claims [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Claim successful on node user
Oct 20 14:39:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:39:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.policy [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72ae5e79e17d464bbdb1ad94786a845e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba769d3e66645dcabea5000576ab8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:39:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Creating image(s)
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "/opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "/opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk 1073741824" returned: 0 in 0.052s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Successfully created port: 5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Cannot resize image /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Ensure instance console log exists: /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Successfully updated port: 5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquired lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-changed-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Refreshing instance network info cache due to event network-changed-5aba93f8-5b6b-47af-b19e-a97f0c115637. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] Acquiring lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updating instance_info_cache with network_info: [{"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Releasing lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Instance network_info: |[{"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] Acquired lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Refreshing network info cache for port 5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Start _get_guest_xml network_info=[{"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:39:05 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:39:05 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-910745528',display_name='tempest-ServersNegativeTestJSON-server-910745528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-910745528',id=18,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba769d3e66645dcabea5000576ab8d5',ramdisk_id='',reservation_id='r-m4mw7mxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069808',owner_user_name='tempest-ServersNegativeTestJSON-2069808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:39:03Z,user_data=None,user_id='72ae5e79e17d464bbdb1ad94786a845e',uuid=2b929936-cca5-4c52-afa4-3c2e9b31284a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converting VIF {"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b929936-cca5-4c52-afa4-3c2e9b31284a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:39:05 user nova-compute[76870]:   <uuid>2b929936-cca5-4c52-afa4-3c2e9b31284a</uuid>
Oct 20 14:39:05 user nova-compute[76870]:   <name>instance-00000012</name>
Oct 20 14:39:05 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:39:05 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:39:05 user nova-compute[76870]:   <metadata>
Oct 20 14:39:05 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:39:05 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:39:05 user nova-compute[76870]:       <nova:name>tempest-ServersNegativeTestJSON-server-910745528</nova:name>
Oct 20 14:39:05 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:39:05</nova:creationTime>
Oct 20 14:39:05 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:39:05 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:39:05 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:39:05 user nova-compute[76870]:       <nova:owner>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:user uuid="72ae5e79e17d464bbdb1ad94786a845e">tempest-ServersNegativeTestJSON-2069808-project-member</nova:user>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:project uuid="7ba769d3e66645dcabea5000576ab8d5">tempest-ServersNegativeTestJSON-2069808</nova:project>
Oct 20 14:39:05 user nova-compute[76870]:       </nova:owner>
Oct 20 14:39:05 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:39:05 user nova-compute[76870]:       <nova:ports>
Oct 20 14:39:05 user nova-compute[76870]:         <nova:port uuid="5aba93f8-5b6b-47af-b19e-a97f0c115637">
Oct 20 14:39:05 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 14:39:05 user nova-compute[76870]:         </nova:port>
Oct 20 14:39:05 user nova-compute[76870]:       </nova:ports>
Oct 20 14:39:05 user nova-compute[76870]:     </nova:instance>
Oct 20 14:39:05 user nova-compute[76870]:   </metadata>
Oct 20 14:39:05 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:39:05 user nova-compute[76870]:     <system>
Oct 20 14:39:05 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:39:05 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:39:05 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:39:05 user nova-compute[76870]:       <entry name="serial">2b929936-cca5-4c52-afa4-3c2e9b31284a</entry>
Oct 20 14:39:05 user nova-compute[76870]:       <entry name="uuid">2b929936-cca5-4c52-afa4-3c2e9b31284a</entry>
Oct 20 14:39:05 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:39:05 user nova-compute[76870]:     </system>
Oct 20 14:39:05 user nova-compute[76870]:   </sysinfo>
Oct 20 14:39:05 user nova-compute[76870]:   <os>
Oct 20 14:39:05 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:39:05 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:39:05 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:39:05 user nova-compute[76870]:   </os>
Oct 20 14:39:05 user nova-compute[76870]:   <features>
Oct 20 14:39:05 user nova-compute[76870]:     <acpi/>
Oct 20 14:39:05 user nova-compute[76870]:     <apic/>
Oct 20 14:39:05 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:39:05 user nova-compute[76870]:   </features>
Oct 20 14:39:05 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:39:05 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:39:05 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:39:05 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:39:05 user nova-compute[76870]:   </clock>
Oct 20 14:39:05 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:39:05 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:39:05 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:39:05 user nova-compute[76870]:   </cpu>
Oct 20 14:39:05 user nova-compute[76870]:   <devices>
Oct 20 14:39:05 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:39:05 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:39:05 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk"/>
Oct 20 14:39:05 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:39:05 user nova-compute[76870]:     </disk>
Oct 20 14:39:05 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:39:05 user nova-compute[76870]:       <mac address="fa:16:3e:19:2d:d9"/>
Oct 20 14:39:05 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:39:05 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:39:05 user nova-compute[76870]:       <target dev="tap5aba93f8-5b"/>
Oct 20 14:39:05 user nova-compute[76870]:     </interface>
Oct 20 14:39:05 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:39:05 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/console.log" append="off"/>
Oct 20 14:39:05 user nova-compute[76870]:     </serial>
Oct 20 14:39:05 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:39:05 user nova-compute[76870]:     <video>
Oct 20 14:39:05 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:39:05 user nova-compute[76870]:     </video>
Oct 20 14:39:05 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:39:05 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:39:05 user nova-compute[76870]:     </rng>
Oct 20 14:39:05 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:39:05 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:39:05 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:39:05 user nova-compute[76870]:     </memballoon>
Oct 20 14:39:05 user nova-compute[76870]:   </devices>
Oct 20 14:39:05 user nova-compute[76870]: </domain>
Oct 20 14:39:05 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-910745528',display_name='tempest-ServersNegativeTestJSON-server-910745528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-910745528',id=18,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba769d3e66645dcabea5000576ab8d5',ramdisk_id='',reservation_id='r-m4mw7mxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069808',owner_user_name='tempest-ServersNegativeTestJSON-2069808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:39:03Z,user_data=None,user_id='72ae5e79e17d464bbdb1ad94786a845e',uuid=2b929936-cca5-4c52-afa4-3c2e9b31284a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converting VIF {"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG os_vif [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23bd0758-8623-5a71-818d-578e6677d057', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5aba93f8-5b, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5aba93f8-5b, col_values=(('qos', UUID('c1e68b27-e1ea-4ae5-9a86-575f7f14708a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5aba93f8-5b, col_values=(('external_ids', {'iface-id': '5aba93f8-5b6b-47af-b19e-a97f0c115637', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:2d:d9', 'vm-uuid': '2b929936-cca5-4c52-afa4-3c2e9b31284a'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:05 user nova-compute[76870]: INFO os_vif [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b')
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] No VIF found with MAC fa:16:3e:19:2d:d9, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updated VIF entry in instance network info cache for port 5aba93f8-5b6b-47af-b19e-a97f0c115637. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG nova.network.neutron [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updating instance_info_cache with network_info: [{"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4c6257d9-c89c-4748-89b9-8be76efd2bca req-fb722897-7c9c-476b-a39f-894941dc55d8 service nova] Releasing lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-3985a103-851a-41d2-bfb6-d33dc1be1ff7 req-6db6a39a-5d1a-49ef-9bab-23a57fedbda1 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3985a103-851a-41d2-bfb6-d33dc1be1ff7 req-6db6a39a-5d1a-49ef-9bab-23a57fedbda1 service nova] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3985a103-851a-41d2-bfb6-d33dc1be1ff7 req-6db6a39a-5d1a-49ef-9bab-23a57fedbda1 service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3985a103-851a-41d2-bfb6-d33dc1be1ff7 req-6db6a39a-5d1a-49ef-9bab-23a57fedbda1 service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-3985a103-851a-41d2-bfb6-d33dc1be1ff7 req-6db6a39a-5d1a-49ef-9bab-23a57fedbda1 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] No waiting events found dispatching network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:07 user nova-compute[76870]: WARNING nova.compute.manager [req-3985a103-851a-41d2-bfb6-d33dc1be1ff7 req-6db6a39a-5d1a-49ef-9bab-23a57fedbda1 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received unexpected event network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 for instance with vm_state building and task_state spawning.
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-changed-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Refreshing instance network info cache due to event network-changed-8eb60e76-707f-4c6b-b0fd-6de87abbc432. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] Acquiring lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] Acquired lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.network.neutron [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Refreshing network info cache for port 8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-3dee3395-6b26-4c6e-bf24-eec160f905a5 req-19bd772a-7357-4c7c-bdf5-918ace0a2278 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3dee3395-6b26-4c6e-bf24-eec160f905a5 req-19bd772a-7357-4c7c-bdf5-918ace0a2278 service nova] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3dee3395-6b26-4c6e-bf24-eec160f905a5 req-19bd772a-7357-4c7c-bdf5-918ace0a2278 service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3dee3395-6b26-4c6e-bf24-eec160f905a5 req-19bd772a-7357-4c7c-bdf5-918ace0a2278 service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-3dee3395-6b26-4c6e-bf24-eec160f905a5 req-19bd772a-7357-4c7c-bdf5-918ace0a2278 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] No waiting events found dispatching network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:09 user nova-compute[76870]: WARNING nova.compute.manager [req-3dee3395-6b26-4c6e-bf24-eec160f905a5 req-19bd772a-7357-4c7c-bdf5-918ace0a2278 service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received unexpected event network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 for instance with vm_state building and task_state spawning.
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:39:09 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Instance spawned successfully.
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:09 user nova-compute[76870]: INFO nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 20 14:39:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:39:10 user nova-compute[76870]: INFO nova.compute.manager [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Took 7.34 seconds to build instance.
Oct 20 14:39:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e4e0eaa-64a3-4989-a479-6e07a03a39f3 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.449s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:10 user nova-compute[76870]: DEBUG nova.network.neutron [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updated VIF entry in instance network info cache for port 8eb60e76-707f-4c6b-b0fd-6de87abbc432. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:39:10 user nova-compute[76870]: DEBUG nova.network.neutron [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updating instance_info_cache with network_info: [{"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e460a336-6c6a-47c0-9f17-70365328342e req-e576d1a4-a64a-4df9-863a-8f79ad6e79ab service nova] Releasing lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HycTlPve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:39:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:39:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:39:13 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb0d192-59b2-4719-9f53-08886ad699f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:39:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[57394834-b974-4906-91fe-8927138c9ece]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e] added
Oct 20 14:39:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5256db93-f501-4d00-982b-7be65e7f134e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e8a643-f38a-4cf6-afa7-cfac10eaa123]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HycTlPve {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HycTlPve" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312912e-29b9-4c9f-ac78-6b17c135ae9a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HycTlPve'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d98b9-6ebe-4065-ba65-a1ce393b6f6a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb09030-bd84-4ae4-84ba-bcf60b8368f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5659b14-af6a-4e78-894f-d7a9fdeb7d74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260]
Oct 20 14:39:13 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260] successful.
Oct 20 14:39:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f4d21-96b3-4fa8-b643-a851f8371478]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf056067-1c96-4b88-99c3-d543c0807e03]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:13 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:13 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[88475735-d77c-4af9-ae15-5106b9b7d994]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HycTlPve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26138656635353561', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138656635353561', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'flavor' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:39:14 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:39:14 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:39:14 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:39:14 user nova-compute[76870]:   <serial>e93d285c-bd08-4535-9859-d5466bd5981e</serial>
Oct 20 14:39:14 user nova-compute[76870]: </disk>
Oct 20 14:39:14 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No VIF found with MAC fa:16:3e:37:9f:c8, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8482421d-ca44-47f2-b927-19cbba360af1 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.864s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG nova.objects.instance [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid c298bfea-a5c5-44a4-a4fd-508f199f46a7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:15 user nova-compute[76870]: INFO nova.compute.manager [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Attaching volume 0c9ecac4-c368-4527-8cf0-8a5ba951696e to /dev/vdb
Oct 20 14:39:15 user nova-compute[76870]: DEBUG os_brick.utils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7625458-2ad1-44be-85e6-bed75bd3f1ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5bb012-ee1f-460a-85c5-76c0f9855bd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba8132-d79d-4bf8-9fe0-219ea8c01bce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b986469-ce1f-4050-9efb-574a30c16109]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:39:16 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:39:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7452b4a-811f-40c3-942f-8c05e4503a17]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG os_brick.utils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:39:16 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updating existing volume attachment record: a2284bca-1834-477a-841e-8d9161c6cdb1 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:18 user nova-compute[76870]: INFO nova.compute.manager [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Terminating instance
Oct 20 14:39:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-98bb2b1e-fa6e-4021-b342-d8672d5e55b7 req-520a04f9-b3e4-481a-a512-06bcbbceaee9 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-vif-unplugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98bb2b1e-fa6e-4021-b342-d8672d5e55b7 req-520a04f9-b3e4-481a-a512-06bcbbceaee9 service nova] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98bb2b1e-fa6e-4021-b342-d8672d5e55b7 req-520a04f9-b3e4-481a-a512-06bcbbceaee9 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98bb2b1e-fa6e-4021-b342-d8672d5e55b7 req-520a04f9-b3e4-481a-a512-06bcbbceaee9 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-98bb2b1e-fa6e-4021-b342-d8672d5e55b7 req-520a04f9-b3e4-481a-a512-06bcbbceaee9 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] No waiting events found dispatching network-vif-unplugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-98bb2b1e-fa6e-4021-b342-d8672d5e55b7 req-520a04f9-b3e4-481a-a512-06bcbbceaee9 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-vif-unplugged-9efda0d6-1c7b-4233-9206-e83e5661af3e for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Instance destroyed successfully.
Oct 20 14:39:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lazy-loading 'resources' on Instance uuid d03d6cc9-1e71-49a9-aaae-f1ec46254200 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1057852179',display_name='tempest-VolumesAdminNegativeTest-server-1057852179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1057852179',id=4,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADpL9PSaEDrERcE6nbtyvq5Jo560y37YtX/0b+lGOaCvUf7rvf63Zg3QFJF019nqXCkg9glrv+RdamhTllsdo6Z3jF8dRWobA06sFND/EhE4ZShcMzEua+s1PIKHwFxqQ==',key_name='tempest-keypair-1576509653',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:31:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f772f1ee2134d1b99bec5ac66ffe495',ramdisk_id='',reservation_id='r-58srqupd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1322350658',owner_user_name='tempest-VolumesAdminNegativeTest-1322350658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f25d5591b5774753b836d3a0e6397166',uuid=d03d6cc9-1e71-49a9-aaae-f1ec46254200,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converting VIF {"id": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "address": "fa:16:3e:df:75:50", "network": {"id": "c8f2a4f5-9637-4530-97e0-40e829a1d0e7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-275433457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f772f1ee2134d1b99bec5ac66ffe495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9efda0d6-1c", "ovs_interfaceid": "9efda0d6-1c7b-4233-9206-e83e5661af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG os_vif [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9efda0d6-1c, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d55256b3-8f36-4bee-bfe5-3da55eb6419a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:19 user nova-compute[76870]: INFO os_vif [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:75:50,bridge_name='br-int',has_traffic_filtering=True,id=9efda0d6-1c7b-4233-9206-e83e5661af3e,network=Network(c8f2a4f5-9637-4530-97e0-40e829a1d0e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9efda0d6-1c')
Oct 20 14:39:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Deleting instance files /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200_del
Oct 20 14:39:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Deletion of /opt/stack/data/nova/instances/d03d6cc9-1e71-49a9-aaae-f1ec46254200_del complete
Oct 20 14:39:19 user nova-compute[76870]: INFO nova.compute.manager [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 14:39:19 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:39:19 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG nova.objects.instance [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'flavor' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:20 user nova-compute[76870]: INFO nova.compute.manager [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attaching volume 8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f to /dev/vdc
Oct 20 14:39:20 user nova-compute[76870]: DEBUG os_brick.utils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7babdde-39e9-4ef5-894a-ac4b60ae5c0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:20 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Took 0.97 seconds to deallocate network for instance.
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9cb165-6a37-4999-bcab-959c05e88aad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2f15e-0f87-4510-a76e-a3559308294c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19211f94-3d77-487d-a593-8c65cd981642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:39:20 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea32f9-7bab-40d0-a491-38dd13416706]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG os_brick.utils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updating existing volume attachment record: 15391465-fb15-4df2-8a31-da7b54092234 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:39:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:20 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Deleted allocations for instance d03d6cc9-1e71-49a9-aaae-f1ec46254200
Oct 20 14:39:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] Acquiring lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] No waiting events found dispatching network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:21 user nova-compute[76870]: WARNING nova.compute.manager [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received unexpected event network-vif-plugged-9efda0d6-1c7b-4233-9206-e83e5661af3e for instance with vm_state deleted and task_state None.
Oct 20 14:39:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-83223d15-d038-4d30-8872-2eedf15bd92d req-917909a3-8700-4f11-b1bd-da9301e2dec4 service nova] [instance: d03d6cc9-1e71-49a9-aaae-f1ec46254200] Received event network-vif-deleted-9efda0d6-1c7b-4233-9206-e83e5661af3e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-27c59081-bea7-4272-a318-f5376052c39e tempest-VolumesAdminNegativeTest-1322350658 tempest-VolumesAdminNegativeTest-1322350658-project-member] Lock "d03d6cc9-1e71-49a9-aaae-f1ec46254200" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.561s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:39:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.587s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPOdbjEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:39:35 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:39:35 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:39:35 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:39:35 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:39:35 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7935MB free_disk=25.360092163085938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b44516-ab84-4776-9975-568664c1e107]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:39:35 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7dba15-00f3-4445-8c4d-01b4acfb117a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e] added
Oct 20 14:39:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[538f78b6-e8e1-4c20-977a-e40369b8efd1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b303b71f-82a5-4f5c-ac16-bfbf9efba210]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPOdbjEY {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPOdbjEY" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bfa6d4-6be4-410e-85bb-028765775239]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TPOdbjEY'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 74ef247a-85bb-4a23-a5f4-f2579122c131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 844f56f6-be92-4c0b-88a9-55a82b330646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35581cd-aff1-402a-add5-d7c29ce28ffc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[879335d8-4739-4fb4-8fca-5dbadcdf8fab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:36 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:36 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d625cfd4-eb0c-4d07-8fe7-927a24e84d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260]
Oct 20 14:39:36 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260] successful.
Oct 20 14:39:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fb33a6-aca1-44a7-900b-005970e2e06d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a673dbe7-524e-43c2-879b-03e53b053363]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:36 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:36 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:39:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:36 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:36 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:39:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe6657f-96a7-469b-971a-cfbb350f2985]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPOdbjEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing instance network info cache due to event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updated VIF entry in instance network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a80d357-a139-4a99-96d0-abc4373979f0 req-1553f540-3a3f-45a4-9b2d-789a3832c2f7 service nova] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26530643239373832', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530643239373832', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid c298bfea-a5c5-44a4-a4fd-508f199f46a7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:39:37 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:39:37 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 14:39:37 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:39:37 user nova-compute[76870]:   <serial>0c9ecac4-c368-4527-8cf0-8a5ba951696e</serial>
Oct 20 14:39:37 user nova-compute[76870]: </disk>
Oct 20 14:39:37 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:5d:f5:6e, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-13e12502-5055-4e8d-9907-d1942ae0ee71 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.889s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:39:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jptPSqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:39:40 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:39:40 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:39:40 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3da6a-9ebd-4905-bf9e-cbfe79b280d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:39:40 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec465c0-e963-4ac4-a04c-f6143750443e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f] added
Oct 20 14:39:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b9768-a0cc-4b1c-ab10-3feab7c4795e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54447077-5570-4dc7-9ad9-b95485f45001]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jptPSqWT {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jptPSqWT" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f33aa-5870-47ef-b62c-8d5a62445a18]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jptPSqWT'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e07b799-6191-4ace-bb8f-0e03355096fb]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb88e94b-49b7-4456-b094-342e0a801746]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87545fb3-82f5-4043-9bfa-ead5a4d204ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260]
Oct 20 14:39:40 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260] successful.
Oct 20 14:39:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b513b8-118b-4968-8c8c-3815c8088e30]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f7b27-ee4d-4907-9bb3-02c9ea011f6d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f (non-flash)
Oct 20 14:39:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:39:40 user nova-compute[76870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f (non-flash)
Oct 20 14:39:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[909a7252-e3b4-483f-86c6-39d582769eae]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:39:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jptPSqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:39:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:39:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26235646562303465', 'path': '/dev/sde'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:39:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235646562303465', 'path': '/dev/sde'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:39:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'flavor' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:39:41 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:39:41 user nova-compute[76870]:   <source dev="/dev/sde"/>
Oct 20 14:39:41 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:39:41 user nova-compute[76870]:   <serial>8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f</serial>
Oct 20 14:39:41 user nova-compute[76870]: </disk>
Oct 20 14:39:41 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:39:42 user nova-compute[76870]: INFO nova.compute.claims [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Claim successful on node user
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] No VIF found with MAC fa:16:3e:37:9f:c8, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-451c3049-1ef5-4864-9237-e5b59dd281cb tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.292s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:39:42 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:39:42 user nova-compute[76870]: DEBUG nova.policy [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9efb8ffb0f7f47f1ab587820e0f72c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3077015e86bc441e8a6622b6af839537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:39:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Creating image(s)
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk 1073741824" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.network.neutron [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Successfully created port: b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.229s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:43 user nova-compute[76870]: INFO nova.compute.manager [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Detaching volume 8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Cannot resize image /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Ensure instance console log exists: /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:43 user nova-compute[76870]: INFO nova.virt.block_device [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attempting to driver detach volume 8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f from mountpoint /dev/vdc
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Attempting to detach device vdc from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:39:43 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:39:43 user nova-compute[76870]:   <source dev="/dev/sde"/>
Oct 20 14:39:43 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:39:43 user nova-compute[76870]:   <serial>8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f</serial>
Oct 20 14:39:43 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 14:39:43 user nova-compute[76870]: </disk>
Oct 20 14:39:43 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:39:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Successfully detached device vdc from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the persistent domain config.
Oct 20 14:39:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:39:44 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:39:44 user nova-compute[76870]:   <source dev="/dev/sde"/>
Oct 20 14:39:44 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:39:44 user nova-compute[76870]:   <serial>8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f</serial>
Oct 20 14:39:44 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 14:39:44 user nova-compute[76870]: </disk>
Oct 20 14:39:44 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:44 user nova-compute[76870]: INFO nova.compute.manager [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Shelving
Oct 20 14:39:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Successfully updated port: b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquired lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-ae092e6a-e037-4b4b-93b1-e07a9b6f2fa3 req-183592dc-565a-4e4f-9af6-5092ad3cf05f service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-unplugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ae092e6a-e037-4b4b-93b1-e07a9b6f2fa3 req-183592dc-565a-4e4f-9af6-5092ad3cf05f service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ae092e6a-e037-4b4b-93b1-e07a9b6f2fa3 req-183592dc-565a-4e4f-9af6-5092ad3cf05f service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ae092e6a-e037-4b4b-93b1-e07a9b6f2fa3 req-183592dc-565a-4e4f-9af6-5092ad3cf05f service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-ae092e6a-e037-4b4b-93b1-e07a9b6f2fa3 req-183592dc-565a-4e4f-9af6-5092ad3cf05f service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-unplugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:44 user nova-compute[76870]: WARNING nova.compute.manager [req-ae092e6a-e037-4b4b-93b1-e07a9b6f2fa3 req-183592dc-565a-4e4f-9af6-5092ad3cf05f service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-unplugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state active and task_state shelving.
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:39:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance destroyed successfully.
Oct 20 14:39:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updating instance_info_cache with network_info: [{"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Releasing lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Instance network_info: |[{"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Start _get_guest_xml network_info=[{"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:39:45 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Beginning cold snapshot process
Oct 20 14:39:45 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:39:45 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:39:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1728280174',display_name='tempest-AttachVolumeNegativeTest-server-1728280174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1728280174',id=19,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZbIvkwMemBPYtTi7FL8W9KqWTkgpBhlAe1f44DzGhGyy5JKIqHtXlVgNPofaG6YjQW2vOiGAdJcx4dAXG7f/9OVk0mMHojmV/79XmAtXOHZIAaIKu1J3AsF0/wntmakw==',key_name='tempest-keypair-233695124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-0ub5ckp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=1ec4c339-8b65-49c8-8a48-3a247ba557e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.objects.instance [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec4c339-8b65-49c8-8a48-3a247ba557e5 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:39:45 user nova-compute[76870]:   <uuid>1ec4c339-8b65-49c8-8a48-3a247ba557e5</uuid>
Oct 20 14:39:45 user nova-compute[76870]:   <name>instance-00000013</name>
Oct 20 14:39:45 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:39:45 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:39:45 user nova-compute[76870]:   <metadata>
Oct 20 14:39:45 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:39:45 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:39:45 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1728280174</nova:name>
Oct 20 14:39:45 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:39:45</nova:creationTime>
Oct 20 14:39:45 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:39:45 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:39:45 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:39:45 user nova-compute[76870]:       <nova:owner>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:user uuid="9efb8ffb0f7f47f1ab587820e0f72c91">tempest-AttachVolumeNegativeTest-742706560-project-member</nova:user>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:project uuid="3077015e86bc441e8a6622b6af839537">tempest-AttachVolumeNegativeTest-742706560</nova:project>
Oct 20 14:39:45 user nova-compute[76870]:       </nova:owner>
Oct 20 14:39:45 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:39:45 user nova-compute[76870]:       <nova:ports>
Oct 20 14:39:45 user nova-compute[76870]:         <nova:port uuid="b58366a4-4b57-4b4a-83f7-67576028d5b1">
Oct 20 14:39:45 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 14:39:45 user nova-compute[76870]:         </nova:port>
Oct 20 14:39:45 user nova-compute[76870]:       </nova:ports>
Oct 20 14:39:45 user nova-compute[76870]:     </nova:instance>
Oct 20 14:39:45 user nova-compute[76870]:   </metadata>
Oct 20 14:39:45 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:39:45 user nova-compute[76870]:     <system>
Oct 20 14:39:45 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:39:45 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:39:45 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:39:45 user nova-compute[76870]:       <entry name="serial">1ec4c339-8b65-49c8-8a48-3a247ba557e5</entry>
Oct 20 14:39:45 user nova-compute[76870]:       <entry name="uuid">1ec4c339-8b65-49c8-8a48-3a247ba557e5</entry>
Oct 20 14:39:45 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:39:45 user nova-compute[76870]:     </system>
Oct 20 14:39:45 user nova-compute[76870]:   </sysinfo>
Oct 20 14:39:45 user nova-compute[76870]:   <os>
Oct 20 14:39:45 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:39:45 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:39:45 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:39:45 user nova-compute[76870]:   </os>
Oct 20 14:39:45 user nova-compute[76870]:   <features>
Oct 20 14:39:45 user nova-compute[76870]:     <acpi/>
Oct 20 14:39:45 user nova-compute[76870]:     <apic/>
Oct 20 14:39:45 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:39:45 user nova-compute[76870]:   </features>
Oct 20 14:39:45 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:39:45 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:39:45 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:39:45 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:39:45 user nova-compute[76870]:   </clock>
Oct 20 14:39:45 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:39:45 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:39:45 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:39:45 user nova-compute[76870]:   </cpu>
Oct 20 14:39:45 user nova-compute[76870]:   <devices>
Oct 20 14:39:45 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:39:45 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:39:45 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk"/>
Oct 20 14:39:45 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:39:45 user nova-compute[76870]:     </disk>
Oct 20 14:39:45 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:39:45 user nova-compute[76870]:       <mac address="fa:16:3e:75:fa:0b"/>
Oct 20 14:39:45 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:39:45 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:39:45 user nova-compute[76870]:       <target dev="tapb58366a4-4b"/>
Oct 20 14:39:45 user nova-compute[76870]:     </interface>
Oct 20 14:39:45 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:39:45 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/console.log" append="off"/>
Oct 20 14:39:45 user nova-compute[76870]:     </serial>
Oct 20 14:39:45 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:39:45 user nova-compute[76870]:     <video>
Oct 20 14:39:45 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:39:45 user nova-compute[76870]:     </video>
Oct 20 14:39:45 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:39:45 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:39:45 user nova-compute[76870]:     </rng>
Oct 20 14:39:45 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:39:45 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:39:45 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:39:45 user nova-compute[76870]:     </memballoon>
Oct 20 14:39:45 user nova-compute[76870]:   </devices>
Oct 20 14:39:45 user nova-compute[76870]: </domain>
Oct 20 14:39:45 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:39:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1728280174',display_name='tempest-AttachVolumeNegativeTest-server-1728280174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1728280174',id=19,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZbIvkwMemBPYtTi7FL8W9KqWTkgpBhlAe1f44DzGhGyy5JKIqHtXlVgNPofaG6YjQW2vOiGAdJcx4dAXG7f/9OVk0mMHojmV/79XmAtXOHZIAaIKu1J3AsF0/wntmakw==',key_name='tempest-keypair-233695124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-0ub5ckp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=1ec4c339-8b65-49c8-8a48-3a247ba557e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG os_vif [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7160729b-d40f-56e8-8149-4e7d653008e2', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb58366a4-4b, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb58366a4-4b, col_values=(('qos', UUID('f6a9a004-60ab-496b-80fd-9f95400596e5')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb58366a4-4b, col_values=(('external_ids', {'iface-id': 'b58366a4-4b57-4b4a-83f7-67576028d5b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:fa:0b', 'vm-uuid': '1ec4c339-8b65-49c8-8a48-3a247ba557e5'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:45 user nova-compute[76870]: INFO os_vif [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b')
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk /opt/stack/data/nova/instances/snapshots/tmpc7w104rt/0cea071a1d6a48a284e86ca3bd416c46 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:75:fa:0b, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:39:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk /opt/stack/data/nova/instances/snapshots/tmpc7w104rt/0cea071a1d6a48a284e86ca3bd416c46" returned: 0 in 0.723s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:39:45 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Snapshot extracted, beginning image upload
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-changed-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Refreshing instance network info cache due to event network-changed-b58366a4-4b57-4b4a-83f7-67576028d5b1. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] Acquiring lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] Acquired lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Refreshing network info cache for port b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-039c4346-eb24-4747-b932-a4621d75e639 req-c2617d25-b684-48a1-bd09-0973a57434ac service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-039c4346-eb24-4747-b932-a4621d75e639 req-c2617d25-b684-48a1-bd09-0973a57434ac service nova] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-039c4346-eb24-4747-b932-a4621d75e639 req-c2617d25-b684-48a1-bd09-0973a57434ac service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-039c4346-eb24-4747-b932-a4621d75e639 req-c2617d25-b684-48a1-bd09-0973a57434ac service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-039c4346-eb24-4747-b932-a4621d75e639 req-c2617d25-b684-48a1-bd09-0973a57434ac service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] No waiting events found dispatching network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:46 user nova-compute[76870]: WARNING nova.compute.manager [req-039c4346-eb24-4747-b932-a4621d75e639 req-c2617d25-b684-48a1-bd09-0973a57434ac service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received unexpected event network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 for instance with vm_state building and task_state spawning.
Oct 20 14:39:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updated VIF entry in instance network info cache for port b58366a4-4b57-4b4a-83f7-67576028d5b1. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updating instance_info_cache with network_info: [{"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] Releasing lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:46 user nova-compute[76870]: WARNING nova.compute.manager [req-f611bda7-a3a0-4d9a-b2b0-71b337cbc265 req-1b6fb7d5-30d5-4e7d-96d2-b5d3989a748d service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 14:39:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Snapshot image upload complete
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:39:48 user nova-compute[76870]: INFO nova.compute.manager [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Shelve offloading
Oct 20 14:39:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance destroyed successfully.
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:39:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Instance spawned successfully.
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-98b584f6-f9b5-441b-97b5-505826702b32 req-a58e3c19-219c-4b5b-b2a7-93014ba9558e service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98b584f6-f9b5-441b-97b5-505826702b32 req-a58e3c19-219c-4b5b-b2a7-93014ba9558e service nova] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98b584f6-f9b5-441b-97b5-505826702b32 req-a58e3c19-219c-4b5b-b2a7-93014ba9558e service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98b584f6-f9b5-441b-97b5-505826702b32 req-a58e3c19-219c-4b5b-b2a7-93014ba9558e service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-98b584f6-f9b5-441b-97b5-505826702b32 req-a58e3c19-219c-4b5b-b2a7-93014ba9558e service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] No waiting events found dispatching network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:39:48 user nova-compute[76870]: WARNING nova.compute.manager [req-98b584f6-f9b5-441b-97b5-505826702b32 req-a58e3c19-219c-4b5b-b2a7-93014ba9558e service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received unexpected event network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 for instance with vm_state building and task_state spawning.
Oct 20 14:39:49 user nova-compute[76870]: INFO nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Took 5.98 seconds to spawn the instance on the hypervisor.
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: INFO nova.compute.manager [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Took 6.83 seconds to build instance.
Oct 20 14:39:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-067af784-3d9b-48b2-8e99-b8592b191bf5 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.929s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance destroyed successfully.
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'resources' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1740794095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1740794095',id=17,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Vht16OCN4sPyGhaf3+hnoNK9immod4cIIJ6znYvCe10mAAb2RHE6Ol3iH8L1oRDb8RL/6sW6PkS7xWx8SYu0ITeMg4JYKTSo+f6rozBLPuvZFuZ+c/OkeliQuvQzK9A==',key_name='tempest-keypair-737388622',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-if0prmy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member',shelved_at='2023-10-20T14:39:48.742679',shelved_host='user',shelved_image_id='e8edb469-a073-4d74-808c-52ea52b47b18'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=844f56f6-be92-4c0b-88a9-55a82b330646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG os_vif [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01c77894-1f, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing instance network info cache due to event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG nova.network.neutron [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c494957-0489-483e-a8ac-2cbd385a841a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:39:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:49 user nova-compute[76870]: INFO os_vif [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f')
Oct 20 14:39:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Deleting instance files /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646_del
Oct 20 14:39:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Deletion of /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646_del complete
Oct 20 14:39:50 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Deleted allocations for instance 844f56f6-be92-4c0b-88a9-55a82b330646
Oct 20 14:39:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'numa_topology' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG nova.objects.base [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<844f56f6-be92-4c0b-88a9-55a82b330646> lazy-loaded attributes: resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updated VIF entry in instance network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap01c77894-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-035fb442-3688-4780-9464-337812f5e10d req-427ee770-6dd4-49b0-a8c8-4afe018a85ea service nova] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a6fea549-1d0c-423f-adfc-4eb4a5ea4b92 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.491s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:39:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:39:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 is timed out.
Oct 20 14:40:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Successfully detached device vdc from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the live domain config.
Oct 20 14:40:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jptPSqWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:04 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce000b-4fec-4f9f-a461-95dafc0f6461]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:40:04 user nova-compute[76870]: No targets found.
Oct 20 14:40:04 user nova-compute[76870]: iSNS:
Oct 20 14:40:04 user nova-compute[76870]: No targets found.
Oct 20 14:40:04 user nova-compute[76870]: STATIC:
Oct 20 14:40:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441
Oct 20 14:40:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:40:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043
Oct 20 14:40:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f
Oct 20 14:40:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e
Oct 20 14:40:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:04 user nova-compute[76870]: FIRMWARE:
Oct 20 14:40:04 user nova-compute[76870]: No targets found.
Oct 20 14:40:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:40:04 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:40:04 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b16aa1-beb4-473e-a9a3-6a531b570e02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[432384df-a762-4c34-8a35-3e127506289f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f (non-flash)
Oct 20 14:40:04 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8473a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f'): ({'sde'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Removing single pathed devices sde {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12f4ca7-4a0f-4d77-b569-3edcb0242d74]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec8f09-b153-4ee7-9ea2-71e565ffd9fb]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Flushing IO for device /dev/sde {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394a4c2-1cb9-49c9-a064-cc66f80c0d5b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2229c2-bdb7-455f-8a4d-838df5ad0dd4]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[470eddf7-34f5-4506-92b8-66a921286978]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[170889c9-3331-43e7-8ec5-d409e77e3650]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260]
Oct 20 14:40:04 user nova-compute[76870]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f, portal: 172.16.0.220,3260] successful.
Oct 20 14:40:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bfcc8d8-00f3-46dd-ba6c-0838e4cf012f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[637e72a2-e1ea-4390-b862-ed4ba7766124]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] <== disconnect_volume: return (358ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:40:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'info_cache' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:13 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance destroyed successfully.
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'resources' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9baeaf20-f1, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c449ef33-4f03-457e-80c6-e5eced03691c) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:13 user nova-compute[76870]: INFO os_vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1')
Oct 20 14:40:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f3aeb5-096e-498d-9a4e-e744c5fcbe1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:40:13 user nova-compute[76870]: No targets found.
Oct 20 14:40:13 user nova-compute[76870]: iSNS:
Oct 20 14:40:13 user nova-compute[76870]: No targets found.
Oct 20 14:40:13 user nova-compute[76870]: STATIC:
Oct 20 14:40:13 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b
Oct 20 14:40:13 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:13 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:13 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441
Oct 20 14:40:13 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:13 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:13 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:40:13 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:13 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:13 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043
Oct 20 14:40:13 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:13 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:13 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e
Oct 20 14:40:13 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:13 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:13 user nova-compute[76870]: FIRMWARE:
Oct 20 14:40:13 user nova-compute[76870]: No targets found.
Oct 20 14:40:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:40:13 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:40:13 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47de0274-f878-48bb-967b-4eb4a955852e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7c8d8-740f-452b-8392-335fe9d75344]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)
Oct 20 14:40:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:13 user nova-compute[76870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)
Oct 20 14:40:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf84ceef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[823df8a1-6c4b-48f3-8633-887112002e9e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5505d16b-3f82-48af-a9c2-1c1437a7a265]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadee7e2-0e7b-4c6e-ad8d-c7dab59408ba]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a50639-fa6d-4f8d-9a40-31ec11b20b5b]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06208515-3553-4ff9-a7eb-41c32c83fff5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3b681d-871e-4e23-97a6-f25585d6451f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]
Oct 20 14:40:14 user nova-compute[76870]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[154599c8-c645-4962-a4af-6471d709a5d5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== disconnect_volume: return (398ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start _get_guest_xml network_info=[{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a3de10d9-7e00-4d88-895a-914da07d45a5', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '231934b4-7eee-443f-bbf4-6253e3e9705c', 'attached_at': '', 'detached_at': '', 'volume_id': '419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'serial': '419b0aa2-eba3-4e57-9fa3-ffc55b2da441'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'numa_topology' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'vcpu_model' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:14 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:14 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:14 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c6219f-6df4-478e-9b37-e1dfe734512c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:40:14 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c023f5be-c75a-40d7-a3a4-d7278228ffbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441] added
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ee8366-74ce-47b4-8d5a-94279ccfaf4f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746a9c0-c82f-4b6a-a108-13bfc35edea3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgzZbTBH {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgzZbTBH" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82749387-d2a8-4331-a395-7d8e79426524]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CgzZbTBH'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84bab10-5cf3-4077-8964-2cd667c50c45]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35cead3-c70c-4edc-9396-e2f87aa09034]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7596b1df-9895-492a-b88c-7bfbb074a071]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]
Oct 20 14:40:14 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[265f37a7-ea2b-46a8-a154-e326a203ff37]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b890ba-7d88-488c-8c06-9aaf61e01d1e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff2bb9d5-0b30-48a5-bfe5-3d5ad84c5043 (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573c3770-976c-4049-9e1f-696f7e49e50b (non-flash)
Oct 20 14:40:14 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d822f33-7302-4d43-bf42-27f298bdbe6e]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'flavor' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-48d48da8-1bf8-445e-8158-4aa1a66ea4dc tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.090s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26435363538346138', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435363538346138', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'pci_devices' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:40:15 user nova-compute[76870]:   <uuid>231934b4-7eee-443f-bbf4-6253e3e9705c</uuid>
Oct 20 14:40:15 user nova-compute[76870]:   <name>instance-0000000c</name>
Oct 20 14:40:15 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:40:15 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:40:15 user nova-compute[76870]:   <metadata>
Oct 20 14:40:15 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:40:15 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:40:15 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeTestJSON-server-573954456</nova:name>
Oct 20 14:40:15 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:40:14</nova:creationTime>
Oct 20 14:40:15 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:40:15 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:40:15 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:40:15 user nova-compute[76870]:       <nova:owner>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:user uuid="859e78a4758a4cafa8e547e12126b1e4">tempest-AttachVolumeTestJSON-345124704-project-member</nova:user>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:project uuid="d99999331a734dc0b3cc9fcc517dfc9a">tempest-AttachVolumeTestJSON-345124704</nova:project>
Oct 20 14:40:15 user nova-compute[76870]:       </nova:owner>
Oct 20 14:40:15 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:40:15 user nova-compute[76870]:       <nova:ports>
Oct 20 14:40:15 user nova-compute[76870]:         <nova:port uuid="9baeaf20-f156-4777-a8cf-c85722913a76">
Oct 20 14:40:15 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:40:15 user nova-compute[76870]:         </nova:port>
Oct 20 14:40:15 user nova-compute[76870]:       </nova:ports>
Oct 20 14:40:15 user nova-compute[76870]:     </nova:instance>
Oct 20 14:40:15 user nova-compute[76870]:   </metadata>
Oct 20 14:40:15 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:40:15 user nova-compute[76870]:     <system>
Oct 20 14:40:15 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:40:15 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:40:15 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:40:15 user nova-compute[76870]:       <entry name="serial">231934b4-7eee-443f-bbf4-6253e3e9705c</entry>
Oct 20 14:40:15 user nova-compute[76870]:       <entry name="uuid">231934b4-7eee-443f-bbf4-6253e3e9705c</entry>
Oct 20 14:40:15 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:40:15 user nova-compute[76870]:     </system>
Oct 20 14:40:15 user nova-compute[76870]:   </sysinfo>
Oct 20 14:40:15 user nova-compute[76870]:   <os>
Oct 20 14:40:15 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:40:15 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:40:15 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:40:15 user nova-compute[76870]:   </os>
Oct 20 14:40:15 user nova-compute[76870]:   <features>
Oct 20 14:40:15 user nova-compute[76870]:     <acpi/>
Oct 20 14:40:15 user nova-compute[76870]:     <apic/>
Oct 20 14:40:15 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:40:15 user nova-compute[76870]:   </features>
Oct 20 14:40:15 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:40:15 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:40:15 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:40:15 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:40:15 user nova-compute[76870]:   </clock>
Oct 20 14:40:15 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:40:15 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:40:15 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:40:15 user nova-compute[76870]:   </cpu>
Oct 20 14:40:15 user nova-compute[76870]:   <devices>
Oct 20 14:40:15 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:40:15 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:40:15 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk"/>
Oct 20 14:40:15 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:40:15 user nova-compute[76870]:     </disk>
Oct 20 14:40:15 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:40:15 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:40:15 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 14:40:15 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:40:15 user nova-compute[76870]:       <serial>419b0aa2-eba3-4e57-9fa3-ffc55b2da441</serial>
Oct 20 14:40:15 user nova-compute[76870]:     </disk>
Oct 20 14:40:15 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:40:15 user nova-compute[76870]:       <mac address="fa:16:3e:1f:2b:34"/>
Oct 20 14:40:15 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:15 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:40:15 user nova-compute[76870]:       <target dev="tap9baeaf20-f1"/>
Oct 20 14:40:15 user nova-compute[76870]:     </interface>
Oct 20 14:40:15 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:40:15 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/console.log" append="off"/>
Oct 20 14:40:15 user nova-compute[76870]:     </serial>
Oct 20 14:40:15 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:40:15 user nova-compute[76870]:     <video>
Oct 20 14:40:15 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:15 user nova-compute[76870]:     </video>
Oct 20 14:40:15 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:40:15 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:40:15 user nova-compute[76870]:     </rng>
Oct 20 14:40:15 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:40:15 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:40:15 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:40:15 user nova-compute[76870]:     </memballoon>
Oct 20 14:40:15 user nova-compute[76870]:   </devices>
Oct 20 14:40:15 user nova-compute[76870]: </domain>
Oct 20 14:40:15 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:40:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'trusted_certs' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.206s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Cannot resize image /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.objects.instance [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'migration_context' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.objects.base [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG os_vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c31edbd-9249-5ed1-b6d1-4bc267a69642', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9baeaf20-f1, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9baeaf20-f1, col_values=(('qos', UUID('e35b6f8e-d8dc-4b67-93dd-35d6280de7c9')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9baeaf20-f1, col_values=(('external_ids', {'iface-id': '9baeaf20-f156-4777-a8cf-c85722913a76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2b:34', 'vm-uuid': '231934b4-7eee-443f-bbf4-6253e3e9705c'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:16 user nova-compute[76870]: INFO os_vif [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1')
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-514d83bb-9170-45a9-b18e-3bee04eab769 req-c7fbe918-294b-4ed7-9d30-efb2343e1939 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-514d83bb-9170-45a9-b18e-3bee04eab769 req-c7fbe918-294b-4ed7-9d30-efb2343e1939 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-514d83bb-9170-45a9-b18e-3bee04eab769 req-c7fbe918-294b-4ed7-9d30-efb2343e1939 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-514d83bb-9170-45a9-b18e-3bee04eab769 req-c7fbe918-294b-4ed7-9d30-efb2343e1939 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-514d83bb-9170-45a9-b18e-3bee04eab769 req-c7fbe918-294b-4ed7-9d30-efb2343e1939 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:18 user nova-compute[76870]: WARNING nova.compute.manager [req-514d83bb-9170-45a9-b18e-3bee04eab769 req-c7fbe918-294b-4ed7-9d30-efb2343e1939 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state stopped and task_state powering-on.
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-83a431db-ac5f-4ee7-8c16-76e9aff92e7a req-b87b51bf-c4b9-49d1-b30e-20ecb870c9d4 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-83a431db-ac5f-4ee7-8c16-76e9aff92e7a req-b87b51bf-c4b9-49d1-b30e-20ecb870c9d4 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-83a431db-ac5f-4ee7-8c16-76e9aff92e7a req-b87b51bf-c4b9-49d1-b30e-20ecb870c9d4 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-83a431db-ac5f-4ee7-8c16-76e9aff92e7a req-b87b51bf-c4b9-49d1-b30e-20ecb870c9d4 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-83a431db-ac5f-4ee7-8c16-76e9aff92e7a req-b87b51bf-c4b9-49d1-b30e-20ecb870c9d4 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:20 user nova-compute[76870]: WARNING nova.compute.manager [req-83a431db-ac5f-4ee7-8c16-76e9aff92e7a req-b87b51bf-c4b9-49d1-b30e-20ecb870c9d4 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state stopped and task_state powering-on.
Oct 20 14:40:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:40:20 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance rebooted successfully.
Oct 20 14:40:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-76d8f076-68c0-402b-a6bd-553c6ef3f5b1 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:40:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:40:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:40:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:34 user nova-compute[76870]: INFO nova.compute.manager [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Detaching volume e93d285c-bd08-4535-9859-d5466bd5981e
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:34 user nova-compute[76870]: INFO nova.virt.block_device [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Attempting to driver detach volume e93d285c-bd08-4535-9859-d5466bd5981e from mountpoint /dev/vdb
Oct 20 14:40:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Attempting to detach device vdb from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:40:34 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:40:34 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:40:34 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:40:34 user nova-compute[76870]:   <serial>e93d285c-bd08-4535-9859-d5466bd5981e</serial>
Oct 20 14:40:34 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:40:34 user nova-compute[76870]: </disk>
Oct 20 14:40:34 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:40:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Successfully detached device vdb from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the persistent domain config.
Oct 20 14:40:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:40:34 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:40:34 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:40:34 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:40:34 user nova-compute[76870]:   <serial>e93d285c-bd08-4535-9859-d5466bd5981e</serial>
Oct 20 14:40:34 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:40:34 user nova-compute[76870]: </disk>
Oct 20 14:40:34 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:40:34 user nova-compute[76870]: INFO nova.compute.manager [None req-231aba45-79a3-4bc1-923f-4d8469df112c tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Get console output
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:35 user nova-compute[76870]: INFO nova.compute.manager [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Terminating instance
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] During wait destroy, instance disappeared. {{(pid=76870) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Oct 20 14:40:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Instance destroyed successfully.
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lazy-loading 'resources' on Instance uuid 92d2469d-6ab3-446e-be34-6a657448fc25 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-642203174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-825684685',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8PQcQNpcaMeuR3Tbq+ugMSrAL3pjWKxDw6zJHwmogZCJUZKwHNcGeLNciZdqccQ89uBsi4Zws2NoA9QS07uGH0kSxae1Btu3OThNA10ueYWROzhSVNn77/jEFKFYkJRw==',key_name='tempest-keypair-1411999794',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='122b62cc9ab847fe847375a3b2150b43',ramdisk_id='',reservation_id='r-nt9wz1ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-279014424',owner_user_name='tempest-ServerActionsV293TestJSON-279014424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23df1790ab3d48c4b5b52c11b9b5bb30',uuid=92d2469d-6ab3-446e-be34-6a657448fc25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converting VIF {"id": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "address": "fa:16:3e:90:f1:e4", "network": {"id": "c4c9d439-e3c0-44e4-9c30-081fd5386399", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1765811572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122b62cc9ab847fe847375a3b2150b43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcfb2365-84", "ovs_interfaceid": "bcfb2365-84e9-4fbb-9d41-cb6901931b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_vif [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcfb2365-84, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:40:35 user nova-compute[76870]: INFO os_vif [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:e4,bridge_name='br-int',has_traffic_filtering=True,id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c,network=Network(c4c9d439-e3c0-44e4-9c30-081fd5386399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcfb2365-84')
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNUOJRPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:35 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1020bca9-0a83-4a22-a86c-404f4f55cbc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:40:35 user nova-compute[76870]: No targets found.
Oct 20 14:40:35 user nova-compute[76870]: iSNS:
Oct 20 14:40:35 user nova-compute[76870]: No targets found.
Oct 20 14:40:35 user nova-compute[76870]: STATIC:
Oct 20 14:40:35 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441
Oct 20 14:40:35 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:35 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:35 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:40:35 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:35 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:35 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e
Oct 20 14:40:35 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:35 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:35 user nova-compute[76870]: FIRMWARE:
Oct 20 14:40:35 user nova-compute[76870]: No targets found.
Oct 20 14:40:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:40:35 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:40:35 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85145293-1072-4fa3-bfd2-91ed71a8cc83', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a2d6fa-bcae-47bf-b50b-b0388961d28c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a71b65-2d0a-4c35-b52b-44db21fb9045]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:35 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:35 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:35 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:35 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c5b80d0>, {}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Disconnecting from: [] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] <== disconnect_volume: return (84ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:40:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Deletion of /opt/stack/data/nova/instances/92d2469d-6ab3-446e-be34-6a657448fc25_del complete
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: INFO nova.compute.manager [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Took 0.28 seconds to destroy the instance on the hypervisor.
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=25.29495620727539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-76be46b9-1eb7-4e6c-bafa-392ac0f00c5a req-97fe8240-8a30-4eae-942f-9b302af7b1b3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Received event network-vif-deleted-bcfb2365-84e9-4fbb-9d41-cb6901931b1c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:36 user nova-compute[76870]: INFO nova.compute.manager [req-76be46b9-1eb7-4e6c-bafa-392ac0f00c5a req-97fe8240-8a30-4eae-942f-9b302af7b1b3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Neutron deleted interface bcfb2365-84e9-4fbb-9d41-cb6901931b1c; detaching it from the instance and deleting it from the info cache
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-76be46b9-1eb7-4e6c-bafa-392ac0f00c5a req-97fe8240-8a30-4eae-942f-9b302af7b1b3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:36 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Took 1.14 seconds to deallocate network for instance.
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-76be46b9-1eb7-4e6c-bafa-392ac0f00c5a req-97fe8240-8a30-4eae-942f-9b302af7b1b3 service nova] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Detach interface failed, port_id=bcfb2365-84e9-4fbb-9d41-cb6901931b1c, reason: Instance 92d2469d-6ab3-446e-be34-6a657448fc25 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 92d2469d-6ab3-446e-be34-6a657448fc25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 74ef247a-85bb-4a23-a5f4-f2579122c131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 1ec4c339-8b65-49c8-8a48-3a247ba557e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:40:36 user nova-compute[76870]: INFO nova.compute.manager [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Took 0.10 seconds to detach 1 volumes for instance.
Oct 20 14:40:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] [instance: 92d2469d-6ab3-446e-be34-6a657448fc25] Deleting volume: 85145293-1072-4fa3-bfd2-91ed71a8cc83 {{(pid=76870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.129s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:40:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:37 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Deleted allocations for instance 92d2469d-6ab3-446e-be34-6a657448fc25
Oct 20 14:40:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ef462a01-9fee-4988-8d90-67036d8e9069 tempest-ServerActionsV293TestJSON-279014424 tempest-ServerActionsV293TestJSON-279014424-project-member] Lock "92d2469d-6ab3-446e-be34-6a657448fc25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'flavor' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:38 user nova-compute[76870]: INFO nova.compute.manager [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Attaching volume 105b8816-be28-469d-9f1c-81069ff42c94 to /dev/vdb
Oct 20 14:40:38 user nova-compute[76870]: DEBUG os_brick.utils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[881267de-d604-4f71-a93e-1cf6359bdf3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[816dce0e-fb04-4106-a750-3f5c479fa442]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef640da-6ca8-408c-9234-e169dc0b056a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7aa1c6-fb41-4a9a-b98c-7a1d25b84fd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:40:38 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fce3eb-c233-4aee-abe7-5ced8a236199]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG os_brick.utils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating existing volume attachment record: 46247200-0e47-48e4-be9b-f8f4a20057d2 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:40:38 user nova-compute[76870]: INFO nova.compute.claims [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Claim successful on node user
Oct 20 14:40:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:40:39 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:40:39 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Creating image(s)
Oct 20 14:40:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "/opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "/opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "4a40e64a712b2fbd0339c6e5b74fa4a55560452a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "4a40e64a712b2fbd0339c6e5b74fa4a55560452a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:39 user nova-compute[76870]: DEBUG nova.policy [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce9bea46975483190038bf47a226ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0587d1c60494c99b9925d303898f203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.part --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG nova.virt.images [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] 587a3c13-319f-4473-869f-8a503395377e was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.part /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Successfully created port: fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.part /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.converted" returned: 0 in 0.234s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "4a40e64a712b2fbd0339c6e5b74fa4a55560452a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.202s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "4a40e64a712b2fbd0339c6e5b74fa4a55560452a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "4a40e64a712b2fbd0339c6e5b74fa4a55560452a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Successfully updated port: fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "refresh_cache-f5f46d70-69fc-4985-ae20-1676a0efd8d0" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquired lock "refresh_cache-f5f46d70-69fc-4985-ae20-1676a0efd8d0" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-changed-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Refreshing instance network info cache due to event network-changed-fce751c5-80f8-4d1e-a29d-623908124d21. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] Acquiring lock "refresh_cache-f5f46d70-69fc-4985-ae20-1676a0efd8d0" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a --force-share --output=json" returned: 0 in 0.229s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a,backing_fmt=raw /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a,backing_fmt=raw /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk 1073741824" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "4a40e64a712b2fbd0339c6e5b74fa4a55560452a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Updating instance_info_cache with network_info: [{"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Releasing lock "refresh_cache-f5f46d70-69fc-4985-ae20-1676a0efd8d0" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Instance network_info: |[{"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] Acquired lock "refresh_cache-f5f46d70-69fc-4985-ae20-1676a0efd8d0" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.neutron [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Refreshing network info cache for port fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Cannot resize image /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Ensure instance console log exists: /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Start _get_guest_xml network_info=[{"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:40:35Z,direct_url=<?>,disk_format='qcow2',id=587a3c13-319f-4473-869f-8a503395377e,min_disk=0,min_ram=0,name='tempest-scenario-img--119579181',owner='a0587d1c60494c99b9925d303898f203',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '587a3c13-319f-4473-869f-8a503395377e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:40:41 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:41 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:40:35Z,direct_url=<?>,disk_format='qcow2',id=587a3c13-319f-4473-869f-8a503395377e,min_disk=0,min_ram=0,name='tempest-scenario-img--119579181',owner='a0587d1c60494c99b9925d303898f203',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2045777051',display_name='tempest-TestMinimumBasicScenario-server-2045777051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2045777051',id=20,image_ref='587a3c13-319f-4473-869f-8a503395377e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2uE8cGA8bmWI7rC9wUi55d1zc4dsXr35M5Ko9PuNTvH9Q0YxMh8rKpoJLDdRbcqTE36LnI4G9iDFGnm8d4sfT1RpDWah7a8HcO7x83UTPnjze/RuyKQWh2fEZ0n3A79Q==',key_name='tempest-TestMinimumBasicScenario-455146338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0587d1c60494c99b9925d303898f203',ramdisk_id='',reservation_id='r-rqjf916u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='587a3c13-319f-4473-869f-8a503395377e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1438762037',owner_user_name='tempest-TestMinimumBasicScenario-1438762037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:40:40Z,user_data=None,user_id='9ce9bea46975483190038bf47a226ced',uuid=f5f46d70-69fc-4985-ae20-1676a0efd8d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converting VIF {"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'pci_devices' on Instance uuid f5f46d70-69fc-4985-ae20-1676a0efd8d0 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:40:41 user nova-compute[76870]:   <uuid>f5f46d70-69fc-4985-ae20-1676a0efd8d0</uuid>
Oct 20 14:40:41 user nova-compute[76870]:   <name>instance-00000014</name>
Oct 20 14:40:41 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:40:41 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:40:41 user nova-compute[76870]:   <metadata>
Oct 20 14:40:41 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:40:41 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:40:41 user nova-compute[76870]:       <nova:name>tempest-TestMinimumBasicScenario-server-2045777051</nova:name>
Oct 20 14:40:41 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:40:41</nova:creationTime>
Oct 20 14:40:41 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:40:41 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:40:41 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:40:41 user nova-compute[76870]:       <nova:owner>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:user uuid="9ce9bea46975483190038bf47a226ced">tempest-TestMinimumBasicScenario-1438762037-project-member</nova:user>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:project uuid="a0587d1c60494c99b9925d303898f203">tempest-TestMinimumBasicScenario-1438762037</nova:project>
Oct 20 14:40:41 user nova-compute[76870]:       </nova:owner>
Oct 20 14:40:41 user nova-compute[76870]:       <nova:root type="image" uuid="587a3c13-319f-4473-869f-8a503395377e"/>
Oct 20 14:40:41 user nova-compute[76870]:       <nova:ports>
Oct 20 14:40:41 user nova-compute[76870]:         <nova:port uuid="fce751c5-80f8-4d1e-a29d-623908124d21">
Oct 20 14:40:41 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 14:40:41 user nova-compute[76870]:         </nova:port>
Oct 20 14:40:41 user nova-compute[76870]:       </nova:ports>
Oct 20 14:40:41 user nova-compute[76870]:     </nova:instance>
Oct 20 14:40:41 user nova-compute[76870]:   </metadata>
Oct 20 14:40:41 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:40:41 user nova-compute[76870]:     <system>
Oct 20 14:40:41 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:40:41 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:40:41 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:40:41 user nova-compute[76870]:       <entry name="serial">f5f46d70-69fc-4985-ae20-1676a0efd8d0</entry>
Oct 20 14:40:41 user nova-compute[76870]:       <entry name="uuid">f5f46d70-69fc-4985-ae20-1676a0efd8d0</entry>
Oct 20 14:40:41 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:40:41 user nova-compute[76870]:     </system>
Oct 20 14:40:41 user nova-compute[76870]:   </sysinfo>
Oct 20 14:40:41 user nova-compute[76870]:   <os>
Oct 20 14:40:41 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:40:41 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:40:41 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:40:41 user nova-compute[76870]:   </os>
Oct 20 14:40:41 user nova-compute[76870]:   <features>
Oct 20 14:40:41 user nova-compute[76870]:     <acpi/>
Oct 20 14:40:41 user nova-compute[76870]:     <apic/>
Oct 20 14:40:41 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:40:41 user nova-compute[76870]:   </features>
Oct 20 14:40:41 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:40:41 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:40:41 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:40:41 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:40:41 user nova-compute[76870]:   </clock>
Oct 20 14:40:41 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:40:41 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:40:41 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:40:41 user nova-compute[76870]:   </cpu>
Oct 20 14:40:41 user nova-compute[76870]:   <devices>
Oct 20 14:40:41 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:40:41 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:40:41 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk"/>
Oct 20 14:40:41 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:40:41 user nova-compute[76870]:     </disk>
Oct 20 14:40:41 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:40:41 user nova-compute[76870]:       <mac address="fa:16:3e:64:c1:92"/>
Oct 20 14:40:41 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:41 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:40:41 user nova-compute[76870]:       <target dev="tapfce751c5-80"/>
Oct 20 14:40:41 user nova-compute[76870]:     </interface>
Oct 20 14:40:41 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:40:41 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/console.log" append="off"/>
Oct 20 14:40:41 user nova-compute[76870]:     </serial>
Oct 20 14:40:41 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:40:41 user nova-compute[76870]:     <video>
Oct 20 14:40:41 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:41 user nova-compute[76870]:     </video>
Oct 20 14:40:41 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:40:41 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:40:41 user nova-compute[76870]:     </rng>
Oct 20 14:40:41 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:40:41 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:40:41 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:40:41 user nova-compute[76870]:     </memballoon>
Oct 20 14:40:41 user nova-compute[76870]:   </devices>
Oct 20 14:40:41 user nova-compute[76870]: </domain>
Oct 20 14:40:41 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2045777051',display_name='tempest-TestMinimumBasicScenario-server-2045777051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2045777051',id=20,image_ref='587a3c13-319f-4473-869f-8a503395377e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2uE8cGA8bmWI7rC9wUi55d1zc4dsXr35M5Ko9PuNTvH9Q0YxMh8rKpoJLDdRbcqTE36LnI4G9iDFGnm8d4sfT1RpDWah7a8HcO7x83UTPnjze/RuyKQWh2fEZ0n3A79Q==',key_name='tempest-TestMinimumBasicScenario-455146338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0587d1c60494c99b9925d303898f203',ramdisk_id='',reservation_id='r-rqjf916u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='587a3c13-319f-4473-869f-8a503395377e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1438762037',owner_user_name='tempest-TestMinimumBasicScenario-1438762037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:40:40Z,user_data=None,user_id='9ce9bea46975483190038bf47a226ced',uuid=f5f46d70-69fc-4985-ae20-1676a0efd8d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converting VIF {"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG os_vif [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '932a1f61-66dd-5a6b-b5d8-fc462a6ff057', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfce751c5-80, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfce751c5-80, col_values=(('qos', UUID('68962833-8edc-4e7c-828b-8eb5f9cdae71')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfce751c5-80, col_values=(('external_ids', {'iface-id': 'fce751c5-80f8-4d1e-a29d-623908124d21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:c1:92', 'vm-uuid': 'f5f46d70-69fc-4985-ae20-1676a0efd8d0'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:41 user nova-compute[76870]: INFO os_vif [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80')
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:40:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No VIF found with MAC fa:16:3e:64:c1:92, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:40:42 user nova-compute[76870]: DEBUG nova.network.neutron [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Updated VIF entry in instance network info cache for port fce751c5-80f8-4d1e-a29d-623908124d21. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:40:42 user nova-compute[76870]: DEBUG nova.network.neutron [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Updating instance_info_cache with network_info: [{"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-09d6d72f-5d08-4da0-9dad-9e7390d07f14 req-e8a4fcb9-fd0e-441e-8468-4e6d75b3a3db service nova] Releasing lock "refresh_cache-f5f46d70-69fc-4985-ae20-1676a0efd8d0" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-5dce1cd0-113e-40c8-a0fa-b0e55f426c7c req-30449b7b-b30b-498e-96b3-a5b1a307f5cc service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5dce1cd0-113e-40c8-a0fa-b0e55f426c7c req-30449b7b-b30b-498e-96b3-a5b1a307f5cc service nova] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5dce1cd0-113e-40c8-a0fa-b0e55f426c7c req-30449b7b-b30b-498e-96b3-a5b1a307f5cc service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5dce1cd0-113e-40c8-a0fa-b0e55f426c7c req-30449b7b-b30b-498e-96b3-a5b1a307f5cc service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-5dce1cd0-113e-40c8-a0fa-b0e55f426c7c req-30449b7b-b30b-498e-96b3-a5b1a307f5cc service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] No waiting events found dispatching network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:43 user nova-compute[76870]: WARNING nova.compute.manager [req-5dce1cd0-113e-40c8-a0fa-b0e55f426c7c req-30449b7b-b30b-498e-96b3-a5b1a307f5cc service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received unexpected event network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 for instance with vm_state building and task_state spawning.
Oct 20 14:40:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:40:45 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Instance spawned successfully.
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:46 user nova-compute[76870]: INFO nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-7e671abb-fc67-4d76-a55f-757ca6915bce req-91f63e20-4360-489d-80ab-c98773902462 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7e671abb-fc67-4d76-a55f-757ca6915bce req-91f63e20-4360-489d-80ab-c98773902462 service nova] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7e671abb-fc67-4d76-a55f-757ca6915bce req-91f63e20-4360-489d-80ab-c98773902462 service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7e671abb-fc67-4d76-a55f-757ca6915bce req-91f63e20-4360-489d-80ab-c98773902462 service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-7e671abb-fc67-4d76-a55f-757ca6915bce req-91f63e20-4360-489d-80ab-c98773902462 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] No waiting events found dispatching network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:46 user nova-compute[76870]: WARNING nova.compute.manager [req-7e671abb-fc67-4d76-a55f-757ca6915bce req-91f63e20-4360-489d-80ab-c98773902462 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received unexpected event network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 for instance with vm_state building and task_state spawning.
Oct 20 14:40:46 user nova-compute[76870]: INFO nova.compute.manager [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Took 7.27 seconds to build instance.
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3a73e0cf-1b0e-4454-ac42-8054b114a9b5 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.392s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:40:46 user nova-compute[76870]: INFO nova.compute.claims [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Claim successful on node user
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:40:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:46 user nova-compute[76870]: DEBUG nova.policy [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26a1441e1a3140d29da68799c0207d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d26bb4eb934036b1ea3cc48b16ed42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:40:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Creating image(s)
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk 1073741824" returned: 0 in 0.072s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Successfully created port: 623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Cannot resize image /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Successfully updated port: 623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquired lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-changed-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Refreshing instance network info cache due to event network-changed-623b384d-045a-4a86-9b9b-d4432a52555f. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] Acquiring lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Releasing lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Instance network_info: |[{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] Acquired lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.network.neutron [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Refreshing network info cache for port 623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Start _get_guest_xml network_info=[{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:40:48 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:48 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:40:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:40:49 user nova-compute[76870]:   <uuid>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</uuid>
Oct 20 14:40:49 user nova-compute[76870]:   <name>instance-00000015</name>
Oct 20 14:40:49 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:40:49 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:40:49 user nova-compute[76870]:   <metadata>
Oct 20 14:40:49 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:40:49 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:40:49 user nova-compute[76870]:       <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:40:49 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:40:48</nova:creationTime>
Oct 20 14:40:49 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:40:49 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:40:49 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:40:49 user nova-compute[76870]:       <nova:owner>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:40:49 user nova-compute[76870]:       </nova:owner>
Oct 20 14:40:49 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:40:49 user nova-compute[76870]:       <nova:ports>
Oct 20 14:40:49 user nova-compute[76870]:         <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:40:49 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:40:49 user nova-compute[76870]:         </nova:port>
Oct 20 14:40:49 user nova-compute[76870]:       </nova:ports>
Oct 20 14:40:49 user nova-compute[76870]:     </nova:instance>
Oct 20 14:40:49 user nova-compute[76870]:   </metadata>
Oct 20 14:40:49 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:40:49 user nova-compute[76870]:     <system>
Oct 20 14:40:49 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:40:49 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:40:49 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:40:49 user nova-compute[76870]:       <entry name="serial">7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:40:49 user nova-compute[76870]:       <entry name="uuid">7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:40:49 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:40:49 user nova-compute[76870]:     </system>
Oct 20 14:40:49 user nova-compute[76870]:   </sysinfo>
Oct 20 14:40:49 user nova-compute[76870]:   <os>
Oct 20 14:40:49 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:40:49 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:40:49 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:40:49 user nova-compute[76870]:   </os>
Oct 20 14:40:49 user nova-compute[76870]:   <features>
Oct 20 14:40:49 user nova-compute[76870]:     <acpi/>
Oct 20 14:40:49 user nova-compute[76870]:     <apic/>
Oct 20 14:40:49 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:40:49 user nova-compute[76870]:   </features>
Oct 20 14:40:49 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:40:49 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:40:49 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:40:49 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:40:49 user nova-compute[76870]:   </clock>
Oct 20 14:40:49 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:40:49 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:40:49 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:40:49 user nova-compute[76870]:   </cpu>
Oct 20 14:40:49 user nova-compute[76870]:   <devices>
Oct 20 14:40:49 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:40:49 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:40:49 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk"/>
Oct 20 14:40:49 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:40:49 user nova-compute[76870]:     </disk>
Oct 20 14:40:49 user nova-compute[76870]:     <disk type="file" device="cdrom">
Oct 20 14:40:49 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 14:40:49 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config"/>
Oct 20 14:40:49 user nova-compute[76870]:       <target dev="hda" bus="ide"/>
Oct 20 14:40:49 user nova-compute[76870]:     </disk>
Oct 20 14:40:49 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:40:49 user nova-compute[76870]:       <mac address="fa:16:3e:23:7d:66"/>
Oct 20 14:40:49 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:49 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:40:49 user nova-compute[76870]:       <target dev="tap623b384d-04"/>
Oct 20 14:40:49 user nova-compute[76870]:     </interface>
Oct 20 14:40:49 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:40:49 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log" append="off"/>
Oct 20 14:40:49 user nova-compute[76870]:     </serial>
Oct 20 14:40:49 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:40:49 user nova-compute[76870]:     <video>
Oct 20 14:40:49 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:49 user nova-compute[76870]:     </video>
Oct 20 14:40:49 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:40:49 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:40:49 user nova-compute[76870]:     </rng>
Oct 20 14:40:49 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:40:49 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:40:49 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:40:49 user nova-compute[76870]:     </memballoon>
Oct 20 14:40:49 user nova-compute[76870]:   </devices>
Oct 20 14:40:49 user nova-compute[76870]: </domain>
Oct 20 14:40:49 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG os_vif [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a44c5ec-bf40-5e7d-82ea-81c59cf13a9c', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap623b384d-04, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap623b384d-04, col_values=(('qos', UUID('d847815b-98ba-48ba-abcf-72b86c609fa0')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap623b384d-04, col_values=(('external_ids', {'iface-id': '623b384d-045a-4a86-9b9b-d4432a52555f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:7d:66', 'vm-uuid': '7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: INFO os_vif [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04')
Oct 20 14:40:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No BDM found with device name hda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No VIF found with MAC fa:16:3e:23:7d:66, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:40:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Using config drive
Oct 20 14:40:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Creating config drive at /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config
Oct 20 14:40:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzt16kyu1 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.network.neutron [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updated VIF entry in instance network info cache for port 623b384d-045a-4a86-9b9b-d4432a52555f. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG nova.network.neutron [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzt16kyu1" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aabfc1ed-d11c-4fdf-b98d-ecc9a0b49829 req-ed1de226-5a54-4109-ae1c-a5e7c7f3f34e service nova] Releasing lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-fe808493-c160-490c-a9b7-c591a5b211e8 req-3fa08f07-40dc-416f-804a-62e34efdbb5e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fe808493-c160-490c-a9b7-c591a5b211e8 req-3fa08f07-40dc-416f-804a-62e34efdbb5e service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fe808493-c160-490c-a9b7-c591a5b211e8 req-3fa08f07-40dc-416f-804a-62e34efdbb5e service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fe808493-c160-490c-a9b7-c591a5b211e8 req-3fa08f07-40dc-416f-804a-62e34efdbb5e service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-fe808493-c160-490c-a9b7-c591a5b211e8 req-3fa08f07-40dc-416f-804a-62e34efdbb5e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:51 user nova-compute[76870]: WARNING nova.compute.manager [req-fe808493-c160-490c-a9b7-c591a5b211e8 req-3fa08f07-40dc-416f-804a-62e34efdbb5e service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f for instance with vm_state building and task_state spawning.
Oct 20 14:40:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-d396bd4b-6e74-48ad-8a5f-337b6e48db97 req-be86f910-8758-44a9-8826-ad423f811a2d service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d396bd4b-6e74-48ad-8a5f-337b6e48db97 req-be86f910-8758-44a9-8826-ad423f811a2d service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d396bd4b-6e74-48ad-8a5f-337b6e48db97 req-be86f910-8758-44a9-8826-ad423f811a2d service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d396bd4b-6e74-48ad-8a5f-337b6e48db97 req-be86f910-8758-44a9-8826-ad423f811a2d service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-d396bd4b-6e74-48ad-8a5f-337b6e48db97 req-be86f910-8758-44a9-8826-ad423f811a2d service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:53 user nova-compute[76870]: WARNING nova.compute.manager [req-d396bd4b-6e74-48ad-8a5f-337b6e48db97 req-be86f910-8758-44a9-8826-ad423f811a2d service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f for instance with vm_state building and task_state spawning.
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:40:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Instance spawned successfully.
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:40:53 user nova-compute[76870]: INFO nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Took 6.56 seconds to spawn the instance on the hypervisor.
Oct 20 14:40:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:40:53 user nova-compute[76870]: INFO nova.compute.manager [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Took 7.42 seconds to build instance.
Oct 20 14:40:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99e5c9ed-6e99-4fe5-9ba9-757a4cc245db tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.539s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.012s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:40:54 user nova-compute[76870]: INFO nova.compute.claims [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Claim successful on node user
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.network.neutron [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:40:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:40:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.policy [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72ae5e79e17d464bbdb1ad94786a845e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba769d3e66645dcabea5000576ab8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:40:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Creating image(s)
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "/opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "/opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "/opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.211s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 is timed out.
Oct 20 14:40:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Successfully detached device vdb from instance 74ef247a-85bb-4a23-a5f4-f2579122c131 from the live domain config.
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HycTlPve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:55 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66679a6e-5f19-41ba-bde3-7085c6f187f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:40:55 user nova-compute[76870]: No targets found.
Oct 20 14:40:55 user nova-compute[76870]: iSNS:
Oct 20 14:40:55 user nova-compute[76870]: No targets found.
Oct 20 14:40:55 user nova-compute[76870]: STATIC:
Oct 20 14:40:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441
Oct 20 14:40:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:40:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e
Oct 20 14:40:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:40:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:40:55 user nova-compute[76870]: FIRMWARE:
Oct 20 14:40:55 user nova-compute[76870]: No targets found.
Oct 20 14:40:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:40:55 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:40:55 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[844981a6-5dc1-43b2-9256-975eda83456f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10643fd-f3e0-41e4-a770-25af5fc5d3f1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:55 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:55 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e (non-flash)
Oct 20 14:40:55 user nova-compute[76870]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:55 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8714670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk 1073741824" returned: 0 in 0.070s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d256d77-8351-484a-9f6f-d0c059aa15b0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a0bc4-6f36-475c-90d6-16241cbd25b4]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0333862-6732-474b-a7ea-a650300a937c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb88ad-fba6-4203-8146-ed78bfd94698]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cae73d-b834-4ec7-86c4-c0195ab2e358]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.network.neutron [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Successfully created port: 47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.264s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2215ea-830d-4f42-9b45-4edd35803975]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260]
Oct 20 14:40:55 user nova-compute[76870]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e, portal: 172.16.0.220,3260] successful.
Oct 20 14:40:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93d285c-bd08-4535-9859-d5466bd5981e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78e685-4c60-491b-bcd7-a6728c4200f0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] <== disconnect_volume: return (520ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:40:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Cannot resize image /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Ensure instance console log exists: /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Successfully updated port: 47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "refresh_cache-e93e28f1-7490-49d3-80a9-a2536b293f32" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquired lock "refresh_cache-e93e28f1-7490-49d3-80a9-a2536b293f32" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-changed-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Refreshing instance network info cache due to event network-changed-47e75c09-af03-481a-8fcc-020ffc4c6109. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] Acquiring lock "refresh_cache-e93e28f1-7490-49d3-80a9-a2536b293f32" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:40:56 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'flavor' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c3a9590b-b37f-4df2-b2f2-8a0568bdf574 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.361s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Updating instance_info_cache with network_info: [{"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Releasing lock "refresh_cache-e93e28f1-7490-49d3-80a9-a2536b293f32" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Instance network_info: |[{"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] Acquired lock "refresh_cache-e93e28f1-7490-49d3-80a9-a2536b293f32" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Refreshing network info cache for port 47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Start _get_guest_xml network_info=[{"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:40:57 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:57 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-146034572',display_name='tempest-ServersNegativeTestJSON-server-146034572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-146034572',id=22,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba769d3e66645dcabea5000576ab8d5',ramdisk_id='',reservation_id='r-0g4cyqp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069808',owner_user_name='tempest-ServersNegativeTestJSON-2069808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:40:55Z,user_data=None,user_id='72ae5e79e17d464bbdb1ad94786a845e',uuid=e93e28f1-7490-49d3-80a9-a2536b293f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converting VIF {"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.objects.instance [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lazy-loading 'pci_devices' on Instance uuid e93e28f1-7490-49d3-80a9-a2536b293f32 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:40:57 user nova-compute[76870]:   <uuid>e93e28f1-7490-49d3-80a9-a2536b293f32</uuid>
Oct 20 14:40:57 user nova-compute[76870]:   <name>instance-00000016</name>
Oct 20 14:40:57 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:40:57 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:40:57 user nova-compute[76870]:   <metadata>
Oct 20 14:40:57 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:40:57 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:40:57 user nova-compute[76870]:       <nova:name>tempest-ServersNegativeTestJSON-server-146034572</nova:name>
Oct 20 14:40:57 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:40:57</nova:creationTime>
Oct 20 14:40:57 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:40:57 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:40:57 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:40:57 user nova-compute[76870]:       <nova:owner>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:user uuid="72ae5e79e17d464bbdb1ad94786a845e">tempest-ServersNegativeTestJSON-2069808-project-member</nova:user>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:project uuid="7ba769d3e66645dcabea5000576ab8d5">tempest-ServersNegativeTestJSON-2069808</nova:project>
Oct 20 14:40:57 user nova-compute[76870]:       </nova:owner>
Oct 20 14:40:57 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:40:57 user nova-compute[76870]:       <nova:ports>
Oct 20 14:40:57 user nova-compute[76870]:         <nova:port uuid="47e75c09-af03-481a-8fcc-020ffc4c6109">
Oct 20 14:40:57 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:40:57 user nova-compute[76870]:         </nova:port>
Oct 20 14:40:57 user nova-compute[76870]:       </nova:ports>
Oct 20 14:40:57 user nova-compute[76870]:     </nova:instance>
Oct 20 14:40:57 user nova-compute[76870]:   </metadata>
Oct 20 14:40:57 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:40:57 user nova-compute[76870]:     <system>
Oct 20 14:40:57 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:40:57 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:40:57 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:40:57 user nova-compute[76870]:       <entry name="serial">e93e28f1-7490-49d3-80a9-a2536b293f32</entry>
Oct 20 14:40:57 user nova-compute[76870]:       <entry name="uuid">e93e28f1-7490-49d3-80a9-a2536b293f32</entry>
Oct 20 14:40:57 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:40:57 user nova-compute[76870]:     </system>
Oct 20 14:40:57 user nova-compute[76870]:   </sysinfo>
Oct 20 14:40:57 user nova-compute[76870]:   <os>
Oct 20 14:40:57 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:40:57 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:40:57 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:40:57 user nova-compute[76870]:   </os>
Oct 20 14:40:57 user nova-compute[76870]:   <features>
Oct 20 14:40:57 user nova-compute[76870]:     <acpi/>
Oct 20 14:40:57 user nova-compute[76870]:     <apic/>
Oct 20 14:40:57 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:40:57 user nova-compute[76870]:   </features>
Oct 20 14:40:57 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:40:57 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:40:57 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:40:57 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:40:57 user nova-compute[76870]:   </clock>
Oct 20 14:40:57 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:40:57 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:40:57 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:40:57 user nova-compute[76870]:   </cpu>
Oct 20 14:40:57 user nova-compute[76870]:   <devices>
Oct 20 14:40:57 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:40:57 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:40:57 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk"/>
Oct 20 14:40:57 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:40:57 user nova-compute[76870]:     </disk>
Oct 20 14:40:57 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:40:57 user nova-compute[76870]:       <mac address="fa:16:3e:bd:2f:ab"/>
Oct 20 14:40:57 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:57 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:40:57 user nova-compute[76870]:       <target dev="tap47e75c09-af"/>
Oct 20 14:40:57 user nova-compute[76870]:     </interface>
Oct 20 14:40:57 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:40:57 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/console.log" append="off"/>
Oct 20 14:40:57 user nova-compute[76870]:     </serial>
Oct 20 14:40:57 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:40:57 user nova-compute[76870]:     <video>
Oct 20 14:40:57 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:40:57 user nova-compute[76870]:     </video>
Oct 20 14:40:57 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:40:57 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:40:57 user nova-compute[76870]:     </rng>
Oct 20 14:40:57 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:40:57 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:40:57 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:40:57 user nova-compute[76870]:     </memballoon>
Oct 20 14:40:57 user nova-compute[76870]:   </devices>
Oct 20 14:40:57 user nova-compute[76870]: </domain>
Oct 20 14:40:57 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-146034572',display_name='tempest-ServersNegativeTestJSON-server-146034572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-146034572',id=22,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba769d3e66645dcabea5000576ab8d5',ramdisk_id='',reservation_id='r-0g4cyqp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069808',owner_user_name='tempest-ServersNegativeTestJSON-2069808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:40:55Z,user_data=None,user_id='72ae5e79e17d464bbdb1ad94786a845e',uuid=e93e28f1-7490-49d3-80a9-a2536b293f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converting VIF {"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG os_vif [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de0b33cb-255e-57b9-a485-4b52b16ba73f', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e75c09-af, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47e75c09-af, col_values=(('qos', UUID('08d62c3f-ebac-4d86-b99f-798fef04b3d6')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47e75c09-af, col_values=(('external_ids', {'iface-id': '47e75c09-af03-481a-8fcc-020ffc4c6109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:2f:ab', 'vm-uuid': 'e93e28f1-7490-49d3-80a9-a2536b293f32'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:57 user nova-compute[76870]: INFO os_vif [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af')
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] No VIF found with MAC fa:16:3e:bd:2f:ab, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Updated VIF entry in instance network info cache for port 47e75c09-af03-481a-8fcc-020ffc4c6109. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Updating instance_info_cache with network_info: [{"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:40:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d4c9205c-3781-405a-b1ee-7d4eede0be5e req-4b465226-faa1-407f-9f68-81f56f9752e0 service nova] Releasing lock "refresh_cache-e93e28f1-7490-49d3-80a9-a2536b293f32" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgoRqOdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:40:58 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:58 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:40:58 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f48f764-83eb-4660-8b47-3a3880f08b45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:40:58 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[62002a82-8490-4650-bdc6-083d609409ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94] added
Oct 20 14:40:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-b597c23c-235e-4422-b4e8-a481687411ef req-1b2d0dbc-fcdf-43f3-bcbf-ab7701acb62f service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b597c23c-235e-4422-b4e8-a481687411ef req-1b2d0dbc-fcdf-43f3-bcbf-ab7701acb62f service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b597c23c-235e-4422-b4e8-a481687411ef req-1b2d0dbc-fcdf-43f3-bcbf-ab7701acb62f service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b597c23c-235e-4422-b4e8-a481687411ef req-1b2d0dbc-fcdf-43f3-bcbf-ab7701acb62f service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-b597c23c-235e-4422-b4e8-a481687411ef req-1b2d0dbc-fcdf-43f3-bcbf-ab7701acb62f service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:40:58 user nova-compute[76870]: WARNING nova.compute.manager [req-b597c23c-235e-4422-b4e8-a481687411ef req-1b2d0dbc-fcdf-43f3-bcbf-ab7701acb62f service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state building and task_state spawning.
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba071ce3-819f-4e28-9f0a-32799e992ad3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d7177-1bd9-487a-bea1-63fc64715851]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgoRqOdr {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgoRqOdr" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fc5c0a-fe5f-44d2-9a3f-d13836a271c0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BgoRqOdr'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[242dc394-285f-4982-a4be-8a7b7e49d5b2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55358380-f95f-4858-9052-c74e59264136]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:59 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:59 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:59 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:59 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5427866c-d190-413f-9cb9-b570e5b388c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260]
Oct 20 14:40:59 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260] successful.
Oct 20 14:40:59 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56513075-2473-4eeb-a6cb-958234ff82b8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860a8f3-22bc-476b-8b34-154ece201c2c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:59 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:59 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:40:59 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:40:59 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:40:59 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:40:59 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba75223-4f59-407d-ab38-bd057ea35473]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:40:59 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgoRqOdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23139323063643937', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139323063643937', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG nova.objects.instance [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'flavor' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:41:00 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:41:00 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:41:00 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:41:00 user nova-compute[76870]:   <serial>105b8816-be28-469d-9f1c-81069ff42c94</serial>
Oct 20 14:41:00 user nova-compute[76870]: </disk>
Oct 20 14:41:00 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:41:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No VIF found with MAC fa:16:3e:66:c7:68, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-261739a5-77fb-456d-9368-6bd9bab3153a tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.541s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-bde306ae-f0b5-4df2-9ba0-99086df2b0b4 req-b1881a77-1c91-4385-ba0d-cca5c825defc service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bde306ae-f0b5-4df2-9ba0-99086df2b0b4 req-b1881a77-1c91-4385-ba0d-cca5c825defc service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bde306ae-f0b5-4df2-9ba0-99086df2b0b4 req-b1881a77-1c91-4385-ba0d-cca5c825defc service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bde306ae-f0b5-4df2-9ba0-99086df2b0b4 req-b1881a77-1c91-4385-ba0d-cca5c825defc service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-bde306ae-f0b5-4df2-9ba0-99086df2b0b4 req-b1881a77-1c91-4385-ba0d-cca5c825defc service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:01 user nova-compute[76870]: WARNING nova.compute.manager [req-bde306ae-f0b5-4df2-9ba0-99086df2b0b4 req-b1881a77-1c91-4385-ba0d-cca5c825defc service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state building and task_state spawning.
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:41:01 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Instance spawned successfully.
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:41:01 user nova-compute[76870]: INFO nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:41:01 user nova-compute[76870]: INFO nova.compute.manager [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Took 7.43 seconds to build instance.
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-512022f4-9a27-42de-b72d-d317df0cfd1b tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.593s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:01 user nova-compute[76870]: INFO nova.compute.manager [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Rescuing
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:41:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-e2f0899a-7db5-4127-a821-3e16aa742a58 req-eeb84249-7935-4728-a430-fbb5134bd4c4 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e2f0899a-7db5-4127-a821-3e16aa742a58 req-eeb84249-7935-4728-a430-fbb5134bd4c4 service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e2f0899a-7db5-4127-a821-3e16aa742a58 req-eeb84249-7935-4728-a430-fbb5134bd4c4 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e2f0899a-7db5-4127-a821-3e16aa742a58 req-eeb84249-7935-4728-a430-fbb5134bd4c4 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-e2f0899a-7db5-4127-a821-3e16aa742a58 req-eeb84249-7935-4728-a430-fbb5134bd4c4 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:02 user nova-compute[76870]: WARNING nova.compute.manager [req-e2f0899a-7db5-4127-a821-3e16aa742a58 req-eeb84249-7935-4728-a430-fbb5134bd4c4 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state active and task_state rescuing.
Oct 20 14:41:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance destroyed successfully.
Oct 20 14:41:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Attempting a stable device rescue
Oct 20 14:41:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=76870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 14:41:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 14:41:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Creating image(s)
Oct 20 14:41:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:03 user nova-compute[76870]: DEBUG nova.objects.instance [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'trusted_certs' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "f8306be75cf1693e098ab0cf679dacdc1d1c3513" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "f8306be75cf1693e098ab0cf679dacdc1d1c3513" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.part --force-share --output=json" returned: 0 in 0.221s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:04 user nova-compute[76870]: DEBUG nova.virt.images [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] f6b679cd-8df7-4443-bbb7-dce7b936de45 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:41:04 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:41:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.part /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-f8406bbf-b553-44ce-a710-2f792a00ea06 req-92031eda-ed3b-445e-834f-bf8db367d191 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f8406bbf-b553-44ce-a710-2f792a00ea06 req-92031eda-ed3b-445e-834f-bf8db367d191 service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f8406bbf-b553-44ce-a710-2f792a00ea06 req-92031eda-ed3b-445e-834f-bf8db367d191 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f8406bbf-b553-44ce-a710-2f792a00ea06 req-92031eda-ed3b-445e-834f-bf8db367d191 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-f8406bbf-b553-44ce-a710-2f792a00ea06 req-92031eda-ed3b-445e-834f-bf8db367d191 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:05 user nova-compute[76870]: WARNING nova.compute.manager [req-f8406bbf-b553-44ce-a710-2f792a00ea06 req-92031eda-ed3b-445e-834f-bf8db367d191 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state active and task_state rescuing.
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.part /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.converted" returned: 0 in 0.430s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "f8306be75cf1693e098ab0cf679dacdc1d1c3513" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.888s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "f8306be75cf1693e098ab0cf679dacdc1d1c3513" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "f8306be75cf1693e098ab0cf679dacdc1d1c3513" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513 --force-share --output=json" returned: 0 in 0.218s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513,backing_fmt=raw /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513,backing_fmt=raw /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "f8306be75cf1693e098ab0cf679dacdc1d1c3513" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'migration_context' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Object Instance<e51d3dd1-98b7-49ad-bacf-f76ae5961963> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Start _get_guest_xml network_info=[{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "vif_mac": "fa:16:3e:66:c7:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f6b679cd-8df7-4443-bbb7-dce7b936de45', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '46247200-0e47-48e4-be9b-f8f4a20057d2', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgoRqOdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e51d3dd1-98b7-49ad-bacf-f76ae5961963', 'attached_at': '', 'detached_at': '', 'volume_id': '105b8816-be28-469d-9f1c-81069ff42c94', 'serial': '105b8816-be28-469d-9f1c-81069ff42c94'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'resources' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Object Instance<e51d3dd1-98b7-49ad-bacf-f76ae5961963> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'numa_topology' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Object Instance<e51d3dd1-98b7-49ad-bacf-f76ae5961963> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:05 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:41:05 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'vcpu_model' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.objects.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Object Instance<e51d3dd1-98b7-49ad-bacf-f76ae5961963> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgoRqOdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:41:05 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:41:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:41:05 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:41:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:41:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:41:05 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:41:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2444b619-661c-42df-93ff-46a62c549c96]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BgoRqOdr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 14:41:06 user nova-compute[76870]: node.name = iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94
Oct 20 14:41:06 user nova-compute[76870]: node.tpgt = -1
Oct 20 14:41:06 user nova-compute[76870]: node.startup = automatic
Oct 20 14:41:06 user nova-compute[76870]: node.leading_login = No
Oct 20 14:41:06 user nova-compute[76870]: iface.iscsi_ifacename = default
Oct 20 14:41:06 user nova-compute[76870]: iface.net_ifacename = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.ipaddress = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.prefix_len = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.hwaddress = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.transport_name = tcp
Oct 20 14:41:06 user nova-compute[76870]: iface.initiatorname = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.vlan_id = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.vlan_priority = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.vlan_state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.iface_num = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.mtu = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.port = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.bootproto = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.subnet_mask = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.gateway = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_alt_client_id = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_dns = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_learn_iqn = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_vendor_id_state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_vendor_id = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.dhcp_slp_da = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.fragmentation = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.gratuitous_arp = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.incoming_forwarding = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.tos_state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.tos = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.ttl = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.delayed_ack = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.tcp_nagle = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.tcp_wsf_state = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.tcp_wsf = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.tcp_timer_scale = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.tcp_timestamp = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.redirect = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.def_task_mgmt_timeout = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.header_digest = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.data_digest = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.immediate_data = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.initial_r2t = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.data_seq_inorder = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.data_pdu_inorder = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.erl = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.max_receive_data_len = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.first_burst_len = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.max_outstanding_r2t = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.max_burst_len = 0
Oct 20 14:41:06 user nova-compute[76870]: iface.chap_auth = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.bidi_chap = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.strict_login_compliance = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.discovery_auth = <empty>
Oct 20 14:41:06 user nova-compute[76870]: iface.discovery_logout = <empty>
Oct 20 14:41:06 user nova-compute[76870]: node.discovery_address = <empty>
Oct 20 14:41:06 user nova-compute[76870]: node.discovery_port = 0
Oct 20 14:41:06 user nova-compute[76870]: node.discovery_type = static
Oct 20 14:41:06 user nova-compute[76870]: node.session.initial_cmdsn = 0
Oct 20 14:41:06 user nova-compute[76870]: node.session.initial_login_retry_max = 8
Oct 20 14:41:06 user nova-compute[76870]: node.session.xmit_thread_priority = -20
Oct 20 14:41:06 user nova-compute[76870]: node.session.cmds_max = 128
Oct 20 14:41:06 user nova-compute[76870]: node.session.queue_depth = 32
Oct 20 14:41:06 user nova-compute[76870]: node.session.nr_sessions = 1
Oct 20 14:41:06 user nova-compute[76870]: node.session.auth.authmethod = CHAP
Oct 20 14:41:06 user nova-compute[76870]: node.session.auth.username = BgoRqOdr
Oct 20 14:41:06 user nova-compute[76870]: node.session.auth.password = ***
Oct 20 14:41:06 user nova-compute[76870]: node.session.auth.username_in = <empty>
Oct 20 14:41:06 user nova-compute[76870]: node.session.auth.password_in = <empty>
Oct 20 14:41:06 user nova-compute[76870]: node.session.auth.chap_algs = MD5
Oct 20 14:41:06 user nova-compute[76870]: node.session.timeo.replacement_timeout = 120
Oct 20 14:41:06 user nova-compute[76870]: node.session.err_timeo.abort_timeout = 15
Oct 20 14:41:06 user nova-compute[76870]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 14:41:06 user nova-compute[76870]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 14:41:06 user nova-compute[76870]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.FastAbort = Yes
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.InitialR2T = No
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.ImmediateData = Yes
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.MaxConnections = 1
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 14:41:06 user nova-compute[76870]: node.session.iscsi.ERL = 0
Oct 20 14:41:06 user nova-compute[76870]: node.session.scan = manual
Oct 20 14:41:06 user nova-compute[76870]: node.session.reopen_max = 0
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].address = 172.16.0.220
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].port = 3260
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].startup = manual
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].tcp.window_size = 524288
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].tcp.type_of_service = 0
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].timeo.logout_timeout = 15
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].timeo.login_timeout = 15
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].timeo.auth_timeout = 45
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].iscsi.DataDigest = None
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].iscsi.IFMarker = No
Oct 20 14:41:06 user nova-compute[76870]: node.conn[0].iscsi.OFMarker = No
Oct 20 14:41:06 user nova-compute[76870]: # END RECORD
Oct 20 14:41:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c0deb-a5ea-40ee-9489-74d1247ab17a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5645197-a6dd-4bc9-b1ef-175f9f5b4a7a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgoRqOdr {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgoRqOdr" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d59b2ef-f80d-4d1b-8260-56a3afb62281]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BgoRqOdr'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d505e-a1a3-4e69-8f35-0027beed28c2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8556ec-e766-4c16-81d0-c2dae51c6e70]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:41:06 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:41:06 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:41:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:41:06 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:41:06 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:41:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c283d-1723-442e-9ece-36ac5b9f1298]: (4, ('0 0 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgoRqOdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.197s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] <== connect_volume: return (199ms) {'type': 'block', 'scsi_wwn': '23139323063643937', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139323063643937', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1236982515',display_name='tempest-ServerStableDeviceRescueTest-server-1236982515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1236982515',id=14,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa0xAD6rR4ur738WniBVFOJTLLjE7g5xf7KHCpl9EPmGFrx5Hk1ZeGbLCrjJRKWZcWm9kpzqlnwXpFYGY4tVS0tLDzx2cUVYco6IszVAWtoNbTsCEGzgLT/dkGG3fXcPw==',key_name='tempest-keypair-114909760',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecc3c7784fb14a7ba60637eb343e4536',ramdisk_id='',reservation_id='r-3ck0n3p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1598823131',owner_user_name='tempest-ServerStableDeviceRescueTest-1598823131-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3094cfbcdd5148aba1d1ce26587df977',uuid=e51d3dd1-98b7-49ad-bacf-f76ae5961963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "vif_mac": "fa:16:3e:66:c7:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converting VIF {"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "vif_mac": "fa:16:3e:66:c7:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'pci_devices' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.objects.base [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Object Instance<e51d3dd1-98b7-49ad-bacf-f76ae5961963> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:41:06 user nova-compute[76870]:   <uuid>e51d3dd1-98b7-49ad-bacf-f76ae5961963</uuid>
Oct 20 14:41:06 user nova-compute[76870]:   <name>instance-0000000e</name>
Oct 20 14:41:06 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:41:06 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:41:06 user nova-compute[76870]:   <metadata>
Oct 20 14:41:06 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:41:06 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:41:06 user nova-compute[76870]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1236982515</nova:name>
Oct 20 14:41:06 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:41:05</nova:creationTime>
Oct 20 14:41:06 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:41:06 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:41:06 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:41:06 user nova-compute[76870]:       <nova:owner>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:user uuid="3094cfbcdd5148aba1d1ce26587df977">tempest-ServerStableDeviceRescueTest-1598823131-project-member</nova:user>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:project uuid="ecc3c7784fb14a7ba60637eb343e4536">tempest-ServerStableDeviceRescueTest-1598823131</nova:project>
Oct 20 14:41:06 user nova-compute[76870]:       </nova:owner>
Oct 20 14:41:06 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:41:06 user nova-compute[76870]:       <nova:ports>
Oct 20 14:41:06 user nova-compute[76870]:         <nova:port uuid="2b5df74b-2f39-43d5-8bfa-c56de7663d71">
Oct 20 14:41:06 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 14:41:06 user nova-compute[76870]:         </nova:port>
Oct 20 14:41:06 user nova-compute[76870]:       </nova:ports>
Oct 20 14:41:06 user nova-compute[76870]:     </nova:instance>
Oct 20 14:41:06 user nova-compute[76870]:   </metadata>
Oct 20 14:41:06 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:41:06 user nova-compute[76870]:     <system>
Oct 20 14:41:06 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:41:06 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:41:06 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:41:06 user nova-compute[76870]:       <entry name="serial">e51d3dd1-98b7-49ad-bacf-f76ae5961963</entry>
Oct 20 14:41:06 user nova-compute[76870]:       <entry name="uuid">e51d3dd1-98b7-49ad-bacf-f76ae5961963</entry>
Oct 20 14:41:06 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:41:06 user nova-compute[76870]:     </system>
Oct 20 14:41:06 user nova-compute[76870]:   </sysinfo>
Oct 20 14:41:06 user nova-compute[76870]:   <os>
Oct 20 14:41:06 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:41:06 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:41:06 user nova-compute[76870]:   </os>
Oct 20 14:41:06 user nova-compute[76870]:   <features>
Oct 20 14:41:06 user nova-compute[76870]:     <acpi/>
Oct 20 14:41:06 user nova-compute[76870]:     <apic/>
Oct 20 14:41:06 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:41:06 user nova-compute[76870]:   </features>
Oct 20 14:41:06 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:41:06 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:41:06 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:41:06 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:41:06 user nova-compute[76870]:   </clock>
Oct 20 14:41:06 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:41:06 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:41:06 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:41:06 user nova-compute[76870]:   </cpu>
Oct 20 14:41:06 user nova-compute[76870]:   <devices>
Oct 20 14:41:06 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:41:06 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:41:06 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk"/>
Oct 20 14:41:06 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:41:06 user nova-compute[76870]:     </disk>
Oct 20 14:41:06 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:41:06 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:41:06 user nova-compute[76870]:       <source dev="/dev/sdc"/>
Oct 20 14:41:06 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:41:06 user nova-compute[76870]:       <serial>105b8816-be28-469d-9f1c-81069ff42c94</serial>
Oct 20 14:41:06 user nova-compute[76870]:     </disk>
Oct 20 14:41:06 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:41:06 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:41:06 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue"/>
Oct 20 14:41:06 user nova-compute[76870]:       <target dev="vdc" bus="virtio"/>
Oct 20 14:41:06 user nova-compute[76870]:       <boot order="1"/>
Oct 20 14:41:06 user nova-compute[76870]:     </disk>
Oct 20 14:41:06 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:41:06 user nova-compute[76870]:       <mac address="fa:16:3e:66:c7:68"/>
Oct 20 14:41:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:41:06 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:41:06 user nova-compute[76870]:       <target dev="tap2b5df74b-2f"/>
Oct 20 14:41:06 user nova-compute[76870]:     </interface>
Oct 20 14:41:06 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:41:06 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/console.log" append="off"/>
Oct 20 14:41:06 user nova-compute[76870]:     </serial>
Oct 20 14:41:06 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:41:06 user nova-compute[76870]:     <video>
Oct 20 14:41:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:41:06 user nova-compute[76870]:     </video>
Oct 20 14:41:06 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:41:06 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:41:06 user nova-compute[76870]:     </rng>
Oct 20 14:41:06 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:41:06 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:41:06 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:41:06 user nova-compute[76870]:     </memballoon>
Oct 20 14:41:06 user nova-compute[76870]:   </devices>
Oct 20 14:41:06 user nova-compute[76870]: </domain>
Oct 20 14:41:06 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:41:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance destroyed successfully.
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:41:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] No VIF found with MAC fa:16:3e:66:c7:68, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:41:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-076c2d2f-0c54-44fb-b971-8d1625240045 req-deedc3f1-ba4c-4153-bcf9-8a2da203865d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-076c2d2f-0c54-44fb-b971-8d1625240045 req-deedc3f1-ba4c-4153-bcf9-8a2da203865d service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-076c2d2f-0c54-44fb-b971-8d1625240045 req-deedc3f1-ba4c-4153-bcf9-8a2da203865d service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-076c2d2f-0c54-44fb-b971-8d1625240045 req-deedc3f1-ba4c-4153-bcf9-8a2da203865d service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-076c2d2f-0c54-44fb-b971-8d1625240045 req-deedc3f1-ba4c-4153-bcf9-8a2da203865d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:08 user nova-compute[76870]: WARNING nova.compute.manager [req-076c2d2f-0c54-44fb-b971-8d1625240045 req-deedc3f1-ba4c-4153-bcf9-8a2da203865d service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state active and task_state rescuing.
Oct 20 14:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-d6f36e21-2ded-4ff4-9c1f-218b3eba4b1d req-230cd41c-e2ad-4c31-8e86-dc9cc0ac64f6 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d6f36e21-2ded-4ff4-9c1f-218b3eba4b1d req-230cd41c-e2ad-4c31-8e86-dc9cc0ac64f6 service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d6f36e21-2ded-4ff4-9c1f-218b3eba4b1d req-230cd41c-e2ad-4c31-8e86-dc9cc0ac64f6 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d6f36e21-2ded-4ff4-9c1f-218b3eba4b1d req-230cd41c-e2ad-4c31-8e86-dc9cc0ac64f6 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-d6f36e21-2ded-4ff4-9c1f-218b3eba4b1d req-230cd41c-e2ad-4c31-8e86-dc9cc0ac64f6 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:10 user nova-compute[76870]: WARNING nova.compute.manager [req-d6f36e21-2ded-4ff4-9c1f-218b3eba4b1d req-230cd41c-e2ad-4c31-8e86-dc9cc0ac64f6 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state active and task_state rescuing.
Oct 20 14:41:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-86085a9a-2c1c-4a89-918a-d4ba1d17a3a3 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:41:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:25 user nova-compute[76870]: INFO nova.compute.manager [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Terminating instance
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-c71473dd-2348-4e47-9aad-28a1ed0e5924 req-ba51d09a-3d33-4ce1-a8ce-5e437809380c service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-vif-unplugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c71473dd-2348-4e47-9aad-28a1ed0e5924 req-ba51d09a-3d33-4ce1-a8ce-5e437809380c service nova] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c71473dd-2348-4e47-9aad-28a1ed0e5924 req-ba51d09a-3d33-4ce1-a8ce-5e437809380c service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c71473dd-2348-4e47-9aad-28a1ed0e5924 req-ba51d09a-3d33-4ce1-a8ce-5e437809380c service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-c71473dd-2348-4e47-9aad-28a1ed0e5924 req-ba51d09a-3d33-4ce1-a8ce-5e437809380c service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] No waiting events found dispatching network-vif-unplugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-c71473dd-2348-4e47-9aad-28a1ed0e5924 req-ba51d09a-3d33-4ce1-a8ce-5e437809380c service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-vif-unplugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:41:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Instance destroyed successfully.
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.objects.instance [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lazy-loading 'resources' on Instance uuid 74ef247a-85bb-4a23-a5f4-f2579122c131 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1043965414',display_name='tempest-TestServerVolumeAttachmentScenario-server-1043965414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1043965414',id=15,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFC5YoFnSxJ6V6M+OdgJ7KAeAd33RjxzHMMBgTInovus2KUd75Dg32S4i3IALclm+uD659c2HZJniZIXqGd+PcClGPbemdzMybr0W86F9cItZntRxIq5RseMlcPTmgllQ==',key_name='tempest-keypair-1266801638',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ada23dc3b7874d0786b6652e7d4113bd',ramdisk_id='',reservation_id='r-9q0oeq69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1748983472',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1748983472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82d72e66a5d848abb44324278b94264c',uuid=74ef247a-85bb-4a23-a5f4-f2579122c131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Converting VIF {"id": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "address": "fa:16:3e:37:9f:c8", "network": {"id": "f9c18ced-fa31-4d67-af34-210412379cff", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1236591296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ada23dc3b7874d0786b6652e7d4113bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5faa1c32-b8", "ovs_interfaceid": "5faa1c32-b887-4eb1-a34a-5a920409c6ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG os_vif [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5faa1c32-b8, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40415ae8-42ad-4e8d-b915-16c16881c289) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:41:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:41:25 user nova-compute[76870]: INFO os_vif [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:9f:c8,bridge_name='br-int',has_traffic_filtering=True,id=5faa1c32-b887-4eb1-a34a-5a920409c6ba,network=Network(f9c18ced-fa31-4d67-af34-210412379cff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5faa1c32-b8')
Oct 20 14:41:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Deleting instance files /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131_del
Oct 20 14:41:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Deletion of /opt/stack/data/nova/instances/74ef247a-85bb-4a23-a5f4-f2579122c131_del complete
Oct 20 14:41:26 user nova-compute[76870]: INFO nova.compute.manager [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 14:41:26 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:41:26 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:41:26 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:27 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Took 1.06 seconds to deallocate network for instance.
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] Acquiring lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] No waiting events found dispatching network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:27 user nova-compute[76870]: WARNING nova.compute.manager [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received unexpected event network-vif-plugged-5faa1c32-b887-4eb1-a34a-5a920409c6ba for instance with vm_state deleted and task_state None.
Oct 20 14:41:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc745d2e-14cf-418f-aa07-febb50c489ba req-28d25062-6ae5-4c81-8fb3-47b4bd869ae2 service nova] [instance: 74ef247a-85bb-4a23-a5f4-f2579122c131] Received event network-vif-deleted-5faa1c32-b887-4eb1-a34a-5a920409c6ba {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:27 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Deleted allocations for instance 74ef247a-85bb-4a23-a5f4-f2579122c131
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1aa86beb-eb03-4d3e-9b9b-7b79b0687c73 tempest-TestServerVolumeAttachmentScenario-1748983472 tempest-TestServerVolumeAttachmentScenario-1748983472-project-member] Lock "74ef247a-85bb-4a23-a5f4-f2579122c131" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:41:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 14:41:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 14:41:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 1 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 14:41:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deletion of /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize failed
Oct 20 14:41:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-changed-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Refreshing instance network info cache due to event network-changed-b58366a4-4b57-4b4a-83f7-67576028d5b1. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] Acquiring lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] Acquired lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.network.neutron [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Refreshing network info cache for port b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:33 user nova-compute[76870]: INFO nova.compute.manager [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Terminating instance
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.network.neutron [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updated VIF entry in instance network info cache for port b58366a4-4b57-4b4a-83f7-67576028d5b1. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG nova.network.neutron [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updating instance_info_cache with network_info: [{"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cd5731b9-a381-4d41-b555-1dbd857fcad9 req-68f54efb-a152-4f66-a6ff-56540d91e23c service nova] Releasing lock "refresh_cache-1ec4c339-8b65-49c8-8a48-3a247ba557e5" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:41:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-ce2277ec-f2d8-480a-b73f-2e021ad66a12 req-826577fa-ad3d-493e-afe4-446e0bb257a0 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-vif-unplugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ce2277ec-f2d8-480a-b73f-2e021ad66a12 req-826577fa-ad3d-493e-afe4-446e0bb257a0 service nova] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ce2277ec-f2d8-480a-b73f-2e021ad66a12 req-826577fa-ad3d-493e-afe4-446e0bb257a0 service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ce2277ec-f2d8-480a-b73f-2e021ad66a12 req-826577fa-ad3d-493e-afe4-446e0bb257a0 service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-ce2277ec-f2d8-480a-b73f-2e021ad66a12 req-826577fa-ad3d-493e-afe4-446e0bb257a0 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] No waiting events found dispatching network-vif-unplugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-ce2277ec-f2d8-480a-b73f-2e021ad66a12 req-826577fa-ad3d-493e-afe4-446e0bb257a0 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-vif-unplugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Instance destroyed successfully.
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.objects.instance [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'resources' on Instance uuid 1ec4c339-8b65-49c8-8a48-3a247ba557e5 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:39:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1728280174',display_name='tempest-AttachVolumeNegativeTest-server-1728280174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1728280174',id=19,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZbIvkwMemBPYtTi7FL8W9KqWTkgpBhlAe1f44DzGhGyy5JKIqHtXlVgNPofaG6YjQW2vOiGAdJcx4dAXG7f/9OVk0mMHojmV/79XmAtXOHZIAaIKu1J3AsF0/wntmakw==',key_name='tempest-keypair-233695124',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-0ub5ckp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=1ec4c339-8b65-49c8-8a48-3a247ba557e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "address": "fa:16:3e:75:fa:0b", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb58366a4-4b", "ovs_interfaceid": "b58366a4-4b57-4b4a-83f7-67576028d5b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG os_vif [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb58366a4-4b, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6a9a004-60ab-496b-80fd-9f95400596e5) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:41:34 user nova-compute[76870]: INFO os_vif [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:fa:0b,bridge_name='br-int',has_traffic_filtering=True,id=b58366a4-4b57-4b4a-83f7-67576028d5b1,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb58366a4-4b')
Oct 20 14:41:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Deleting instance files /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5_del
Oct 20 14:41:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Deletion of /opt/stack/data/nova/instances/1ec4c339-8b65-49c8-8a48-3a247ba557e5_del complete
Oct 20 14:41:34 user nova-compute[76870]: INFO nova.compute.manager [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:41:34 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '1ec4c339-8b65-49c8-8a48-3a247ba557e5' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '1ec4c339-8b65-49c8-8a48-3a247ba557e5' (instance-00000013)
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-faa805a0-374f-4a61-81e9-8f1c5cc7a160 req-da3862c9-8b5b-4713-9be9-52db3c0dfa16 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-vif-deleted-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:35 user nova-compute[76870]: INFO nova.compute.manager [req-faa805a0-374f-4a61-81e9-8f1c5cc7a160 req-da3862c9-8b5b-4713-9be9-52db3c0dfa16 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Neutron deleted interface b58366a4-4b57-4b4a-83f7-67576028d5b1; detaching it from the instance and deleting it from the info cache
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.network.neutron [req-faa805a0-374f-4a61-81e9-8f1c5cc7a160 req-da3862c9-8b5b-4713-9be9-52db3c0dfa16 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:35 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Took 0.78 seconds to deallocate network for instance.
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.compute.manager [req-faa805a0-374f-4a61-81e9-8f1c5cc7a160 req-da3862c9-8b5b-4713-9be9-52db3c0dfa16 service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Detach interface failed, port_id=b58366a4-4b57-4b4a-83f7-67576028d5b1, reason: Instance 1ec4c339-8b65-49c8-8a48-3a247ba557e5 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-4be08487-5641-4137-8d07-efd42290fd97 req-e2af39d9-12e0-4afa-950e-d3f032fa614c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received event network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4be08487-5641-4137-8d07-efd42290fd97 req-e2af39d9-12e0-4afa-950e-d3f032fa614c service nova] Acquiring lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4be08487-5641-4137-8d07-efd42290fd97 req-e2af39d9-12e0-4afa-950e-d3f032fa614c service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4be08487-5641-4137-8d07-efd42290fd97 req-e2af39d9-12e0-4afa-950e-d3f032fa614c service nova] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-4be08487-5641-4137-8d07-efd42290fd97 req-e2af39d9-12e0-4afa-950e-d3f032fa614c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] No waiting events found dispatching network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:41:36 user nova-compute[76870]: WARNING nova.compute.manager [req-4be08487-5641-4137-8d07-efd42290fd97 req-e2af39d9-12e0-4afa-950e-d3f032fa614c service nova] [instance: 1ec4c339-8b65-49c8-8a48-3a247ba557e5] Received unexpected event network-vif-plugged-b58366a4-4b57-4b4a-83f7-67576028d5b1 for instance with vm_state deleted and task_state None.
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.017s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:36 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Deleted allocations for instance 1ec4c339-8b65-49c8-8a48-3a247ba557e5
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d4c8fcf9-a674-4250-ac4a-ffcf49f59fa6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "1ec4c339-8b65-49c8-8a48-3a247ba557e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.928s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:37 user nova-compute[76870]: INFO nova.compute.manager [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Unshelving
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: INFO nova.virt.block_device [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Booting with volume 7edd0f47-e617-4667-a13b-d540627e4440 at /dev/vdc
Oct 20 14:41:37 user nova-compute[76870]: DEBUG os_brick.utils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e7573-17e1-4f2a-b875-f4ed0fd30ef0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff87330-0f95-4f22-8c64-27f7bbf1dee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b9875f-2780-417b-a008-ee69f3e2ba6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f3818a-0812-4400-8eca-b42ae09c136e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:41:37 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[da415a55-0aa6-4a0d-81ac-ebae009c027d]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG os_brick.utils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating existing volume attachment record: 4cdd633e-f551-4585-8f4a-000fa911b4da {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:41:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=25.068187713623047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f46d70-69fc-4985-ae20-1676a0efd8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e93e28f1-7490-49d3-80a9-a2536b293f32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 844f56f6-be92-4c0b-88a9-55a82b330646 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:41:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:39 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:41:39 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:41:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updating instance_info_cache with network_info: [{"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c298bfea-a5c5-44a4-a4fd-508f199f46a7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:41:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'pci_requests' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'numa_topology' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:41:54 user nova-compute[76870]: INFO nova.compute.claims [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Claim successful on node user
Oct 20 14:41:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:41:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:54 user nova-compute[76870]: INFO nova.network.neutron [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating port 01c77894-1f28-4395-81e2-ca97beaf0d5c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG nova.network.neutron [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing instance network info cache due to event network-changed-01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:41:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] Acquiring lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:41:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Creating image(s)
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG nova.objects.instance [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'trusted_certs' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] Acquired lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Refreshing network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG nova.objects.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<844f56f6-be92-4c0b-88a9-55a82b330646> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "e1a5c8242a9b99c643904e71aa6473458f9e56e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "e1a5c8242a9b99c643904e71aa6473458f9e56e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.part --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG nova.virt.images [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] e8edb469-a073-4d74-808c-52ea52b47b18 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.part /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updated VIF entry in instance network info cache for port 01c77894-1f28-4395-81e2-ca97beaf0d5c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b44f0ca8-c423-44a8-92b3-98cf81f8df64 req-b3ea8db7-d3ff-4cfa-b454-30e9770ce28c service nova] Releasing lock "refresh_cache-844f56f6-be92-4c0b-88a9-55a82b330646" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.part /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.converted" returned: 0 in 0.251s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "e1a5c8242a9b99c643904e71aa6473458f9e56e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.494s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "e1a5c8242a9b99c643904e71aa6473458f9e56e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "e1a5c8242a9b99c643904e71aa6473458f9e56e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3,backing_fmt=raw /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3,backing_fmt=raw /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk 1073741824" returned: 0 in 0.054s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "e1a5c8242a9b99c643904e71aa6473458f9e56e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG nova.objects.instance [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'migration_context' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG nova.objects.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<844f56f6-be92-4c0b-88a9-55a82b330646> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:41:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Rebasing disk image.
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:41:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 -F raw /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 -F raw /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk" returned: 0 in 2.217s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Ensure instance console log exists: /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Start _get_guest_xml network_info=[{"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a44e5a6e6528a36ab2fa0c20c3027f97',container_format='bare',created_at=2023-10-20T14:39:44Z,direct_url=<?>,disk_format='qcow2',id=e8edb469-a073-4d74-808c-52ea52b47b18,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1740794095-shelved',owner='b3670195fbec411c891e3ea8820b01d1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T14:39:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4cdd633e-f551-4585-8f4a-000fa911b4da', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghMeQsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '844f56f6-be92-4c0b-88a9-55a82b330646', 'attached_at': '', 'detached_at': '', 'volume_id': '7edd0f47-e617-4667-a13b-d540627e4440', 'serial': '7edd0f47-e617-4667-a13b-d540627e4440'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:42:01 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:42:01 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a44e5a6e6528a36ab2fa0c20c3027f97',container_format='bare',created_at=2023-10-20T14:39:44Z,direct_url=<?>,disk_format='qcow2',id=e8edb469-a073-4d74-808c-52ea52b47b18,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1740794095-shelved',owner='b3670195fbec411c891e3ea8820b01d1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T14:39:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.objects.instance [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'vcpu_model' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.objects.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<844f56f6-be92-4c0b-88a9-55a82b330646> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghMeQsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:42:01 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:42:01 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:42:01 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260" returned: 21 in 0.090s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a9629-9663-4e97-bbb1-d565aedd5318]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:42:01 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36fb6d-dba5-41d3-bd8d-b1393d26c3d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440] added
Oct 20 14:42:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f6e4f4-282a-4643-bef7-214eb04a6a83]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec9642-ea63-472d-a6eb-173c3e7dbc0f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghMeQsDL {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghMeQsDL" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1892a46b-a239-41fe-912d-23bc1f3251d1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ghMeQsDL'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d8b2f-9fb2-42a6-8e3b-64e487cfd008]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d5360-74fa-48f7-93f4-2cce9bea1c53]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[475db687-b2de-4bac-bcee-6dd87207a4d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260]
Oct 20 14:42:01 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260] successful.
Oct 20 14:42:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fdc4cc-1bf5-4048-87db-18a27333552f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9ad65-99f8-4ed6-9084-856da20dfbb1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:42:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e531d406-75ef-498b-b80a-cb5d9bd974a1]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghMeQsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26336363532313763', 'path': '/dev/sde'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336363532313763', 'path': '/dev/sde'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1740794095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1740794095',id=17,image_ref='e8edb469-a073-4d74-808c-52ea52b47b18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-737388622',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-if0prmy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member',shelved_at='2023-10-20T14:39:48.742679',shelved_host='user',shelved_image_id='e8edb469-a073-4d74-808c-52ea52b47b18'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=844f56f6-be92-4c0b-88a9-55a82b330646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.objects.instance [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'pci_devices' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.objects.base [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<844f56f6-be92-4c0b-88a9-55a82b330646> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:42:02 user nova-compute[76870]:   <uuid>844f56f6-be92-4c0b-88a9-55a82b330646</uuid>
Oct 20 14:42:02 user nova-compute[76870]:   <name>instance-00000011</name>
Oct 20 14:42:02 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:42:02 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:42:02 user nova-compute[76870]:   <metadata>
Oct 20 14:42:02 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:42:02 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:42:02 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1740794095</nova:name>
Oct 20 14:42:02 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:42:01</nova:creationTime>
Oct 20 14:42:02 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:42:02 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:42:02 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:42:02 user nova-compute[76870]:       <nova:owner>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:user uuid="a358910175f646c39bb6d7e12ed5334e">tempest-AttachVolumeShelveTestJSON-801976804-project-member</nova:user>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:project uuid="b3670195fbec411c891e3ea8820b01d1">tempest-AttachVolumeShelveTestJSON-801976804</nova:project>
Oct 20 14:42:02 user nova-compute[76870]:       </nova:owner>
Oct 20 14:42:02 user nova-compute[76870]:       <nova:root type="image" uuid="e8edb469-a073-4d74-808c-52ea52b47b18"/>
Oct 20 14:42:02 user nova-compute[76870]:       <nova:ports>
Oct 20 14:42:02 user nova-compute[76870]:         <nova:port uuid="01c77894-1f28-4395-81e2-ca97beaf0d5c">
Oct 20 14:42:02 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 14:42:02 user nova-compute[76870]:         </nova:port>
Oct 20 14:42:02 user nova-compute[76870]:       </nova:ports>
Oct 20 14:42:02 user nova-compute[76870]:     </nova:instance>
Oct 20 14:42:02 user nova-compute[76870]:   </metadata>
Oct 20 14:42:02 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:42:02 user nova-compute[76870]:     <system>
Oct 20 14:42:02 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:42:02 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:42:02 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:42:02 user nova-compute[76870]:       <entry name="serial">844f56f6-be92-4c0b-88a9-55a82b330646</entry>
Oct 20 14:42:02 user nova-compute[76870]:       <entry name="uuid">844f56f6-be92-4c0b-88a9-55a82b330646</entry>
Oct 20 14:42:02 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:42:02 user nova-compute[76870]:     </system>
Oct 20 14:42:02 user nova-compute[76870]:   </sysinfo>
Oct 20 14:42:02 user nova-compute[76870]:   <os>
Oct 20 14:42:02 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:42:02 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:42:02 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:42:02 user nova-compute[76870]:   </os>
Oct 20 14:42:02 user nova-compute[76870]:   <features>
Oct 20 14:42:02 user nova-compute[76870]:     <acpi/>
Oct 20 14:42:02 user nova-compute[76870]:     <apic/>
Oct 20 14:42:02 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:42:02 user nova-compute[76870]:   </features>
Oct 20 14:42:02 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:42:02 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:42:02 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:42:02 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:42:02 user nova-compute[76870]:   </clock>
Oct 20 14:42:02 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:42:02 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:42:02 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:42:02 user nova-compute[76870]:   </cpu>
Oct 20 14:42:02 user nova-compute[76870]:   <devices>
Oct 20 14:42:02 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:42:02 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:42:02 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk"/>
Oct 20 14:42:02 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:42:02 user nova-compute[76870]:     </disk>
Oct 20 14:42:02 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:42:02 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:42:02 user nova-compute[76870]:       <source dev="/dev/sde"/>
Oct 20 14:42:02 user nova-compute[76870]:       <target dev="vdc" bus="virtio"/>
Oct 20 14:42:02 user nova-compute[76870]:       <serial>7edd0f47-e617-4667-a13b-d540627e4440</serial>
Oct 20 14:42:02 user nova-compute[76870]:     </disk>
Oct 20 14:42:02 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:42:02 user nova-compute[76870]:       <mac address="fa:16:3e:c1:da:15"/>
Oct 20 14:42:02 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:42:02 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:42:02 user nova-compute[76870]:       <target dev="tap01c77894-1f"/>
Oct 20 14:42:02 user nova-compute[76870]:     </interface>
Oct 20 14:42:02 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:42:02 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/console.log" append="off"/>
Oct 20 14:42:02 user nova-compute[76870]:     </serial>
Oct 20 14:42:02 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:42:02 user nova-compute[76870]:     <video>
Oct 20 14:42:02 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:42:02 user nova-compute[76870]:     </video>
Oct 20 14:42:02 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:42:02 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:42:02 user nova-compute[76870]:     </rng>
Oct 20 14:42:02 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:42:02 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:42:02 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:42:02 user nova-compute[76870]:     </memballoon>
Oct 20 14:42:02 user nova-compute[76870]:   </devices>
Oct 20 14:42:02 user nova-compute[76870]: </domain>
Oct 20 14:42:02 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1740794095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1740794095',id=17,image_ref='e8edb469-a073-4d74-808c-52ea52b47b18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-737388622',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-if0prmy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member',shelved_at='2023-10-20T14:39:48.742679',shelved_host='user',shelved_image_id='e8edb469-a073-4d74-808c-52ea52b47b18'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=844f56f6-be92-4c0b-88a9-55a82b330646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG os_vif [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0768f3ed-9741-54ec-8d31-2358903fea16', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01c77894-1f, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01c77894-1f, col_values=(('qos', UUID('991987ad-2559-4e42-9838-ac5cac8b3de7')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01c77894-1f, col_values=(('external_ids', {'iface-id': '01c77894-1f28-4395-81e2-ca97beaf0d5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:da:15', 'vm-uuid': '844f56f6-be92-4c0b-88a9-55a82b330646'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:02 user nova-compute[76870]: INFO os_vif [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f')
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:42:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No VIF found with MAC fa:16:3e:c1:da:15, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-68d11249-9c2a-4072-9175-782015cf26eb req-ac480399-35d9-4a9b-a6cc-f0338829a00b service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68d11249-9c2a-4072-9175-782015cf26eb req-ac480399-35d9-4a9b-a6cc-f0338829a00b service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68d11249-9c2a-4072-9175-782015cf26eb req-ac480399-35d9-4a9b-a6cc-f0338829a00b service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68d11249-9c2a-4072-9175-782015cf26eb req-ac480399-35d9-4a9b-a6cc-f0338829a00b service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-68d11249-9c2a-4072-9175-782015cf26eb req-ac480399-35d9-4a9b-a6cc-f0338829a00b service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:04 user nova-compute[76870]: WARNING nova.compute.manager [req-68d11249-9c2a-4072-9175-782015cf26eb req-ac480399-35d9-4a9b-a6cc-f0338829a00b service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 14:42:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:04 user nova-compute[76870]: INFO nova.compute.manager [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Detaching volume 419b0aa2-eba3-4e57-9fa3-ffc55b2da441
Oct 20 14:42:04 user nova-compute[76870]: INFO nova.virt.block_device [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Attempting to driver detach volume 419b0aa2-eba3-4e57-9fa3-ffc55b2da441 from mountpoint /dev/vdb
Oct 20 14:42:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Attempting to detach device vdb from instance 231934b4-7eee-443f-bbf4-6253e3e9705c from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:42:04 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:42:04 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:42:04 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:42:04 user nova-compute[76870]:   <serial>419b0aa2-eba3-4e57-9fa3-ffc55b2da441</serial>
Oct 20 14:42:04 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 14:42:04 user nova-compute[76870]: </disk>
Oct 20 14:42:04 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:42:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully detached device vdb from instance 231934b4-7eee-443f-bbf4-6253e3e9705c from the persistent domain config.
Oct 20 14:42:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 231934b4-7eee-443f-bbf4-6253e3e9705c from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:42:04 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:42:04 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:42:04 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:42:04 user nova-compute[76870]:   <serial>419b0aa2-eba3-4e57-9fa3-ffc55b2da441</serial>
Oct 20 14:42:04 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 14:42:04 user nova-compute[76870]: </disk>
Oct 20 14:42:04 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:42:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:42:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-13ab86c6-cd72-4a8a-b9aa-70114d23bf7d req-a84c9e89-68eb-4ffb-b18d-3a5498e99643 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13ab86c6-cd72-4a8a-b9aa-70114d23bf7d req-a84c9e89-68eb-4ffb-b18d-3a5498e99643 service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13ab86c6-cd72-4a8a-b9aa-70114d23bf7d req-a84c9e89-68eb-4ffb-b18d-3a5498e99643 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13ab86c6-cd72-4a8a-b9aa-70114d23bf7d req-a84c9e89-68eb-4ffb-b18d-3a5498e99643 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-13ab86c6-cd72-4a8a-b9aa-70114d23bf7d req-a84c9e89-68eb-4ffb-b18d-3a5498e99643 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:06 user nova-compute[76870]: WARNING nova.compute.manager [req-13ab86c6-cd72-4a8a-b9aa-70114d23bf7d req-a84c9e89-68eb-4ffb-b18d-3a5498e99643 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 14:42:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:42:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:42:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance spawned successfully.
Oct 20 14:42:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:42:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-bed6bb95-0748-4f70-a458-cc11aa5eea15 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.010s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:25 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 231934b4-7eee-443f-bbf4-6253e3e9705c is timed out.
Oct 20 14:42:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully detached device vdb from instance 231934b4-7eee-443f-bbf4-6253e3e9705c from the live domain config.
Oct 20 14:42:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgzZbTBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:42:25 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4075a7-4609-47fd-b55e-1a512247770f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:42:25 user nova-compute[76870]: No targets found.
Oct 20 14:42:25 user nova-compute[76870]: iSNS:
Oct 20 14:42:25 user nova-compute[76870]: No targets found.
Oct 20 14:42:25 user nova-compute[76870]: STATIC:
Oct 20 14:42:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441
Oct 20 14:42:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94
Oct 20 14:42:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440
Oct 20 14:42:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:42:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:25 user nova-compute[76870]: FIRMWARE:
Oct 20 14:42:25 user nova-compute[76870]: No targets found.
Oct 20 14:42:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:42:25 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:42:25 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a04ce9a-7144-4eaf-bab5-f1d0ce507d18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedfebb9-147a-4d73-b120-0b823b4874c5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:25 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:42:25 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:25 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:42:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:25 user nova-compute[76870]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 (non-flash)
Oct 20 14:42:25 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:25 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:42:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c5b8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6321deed-56e0-4f83-9d28-ef6b0ac99755]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fa3da4-046f-4363-96b7-f233a128a45a]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7eae5a-1ac6-419f-8a8b-fbeab8d4760e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a4f42-a3ca-404e-beb5-2e66fa3fd999]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:42:25 user nova-compute[76870]: INFO nova.compute.manager [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Detaching volume 0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[60176d21-40f0-4776-9dea-a73fd1809a3d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3a73b-a9b1-4ae4-8a56-8c1671a7a3f4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260]
Oct 20 14:42:25 user nova-compute[76870]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441, portal: 172.16.0.220,3260] successful.
Oct 20 14:42:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:419b0aa2-eba3-4e57-9fa3-ffc55b2da441 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb91621-8682-450d-b0e1-2a6a4e7f62fc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== disconnect_volume: return (331ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:42:25 user nova-compute[76870]: INFO nova.virt.block_device [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Attempting to driver detach volume 0c9ecac4-c368-4527-8cf0-8a5ba951696e from mountpoint /dev/vdb
Oct 20 14:42:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Attempting to detach device vdb from instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:42:25 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:42:25 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 14:42:25 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:42:25 user nova-compute[76870]:   <serial>0c9ecac4-c368-4527-8cf0-8a5ba951696e</serial>
Oct 20 14:42:25 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:42:25 user nova-compute[76870]: </disk>
Oct 20 14:42:25 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:42:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully detached device vdb from instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 from the persistent domain config.
Oct 20 14:42:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:42:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:42:25 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:42:25 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 14:42:25 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:42:25 user nova-compute[76870]:   <serial>0c9ecac4-c368-4527-8cf0-8a5ba951696e</serial>
Oct 20 14:42:25 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:42:25 user nova-compute[76870]: </disk>
Oct 20 14:42:25 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:42:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:42:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9439f41f-b385-43d3-80c8-5729f4d66b49 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.868s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76870) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a691c04-940f-4f7c-9d2b-9cd319087c16 req-0696771d-5f7e-4c62-960c-f140f48ccb3e service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a691c04-940f-4f7c-9d2b-9cd319087c16 req-0696771d-5f7e-4c62-960c-f140f48ccb3e service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a691c04-940f-4f7c-9d2b-9cd319087c16 req-0696771d-5f7e-4c62-960c-f140f48ccb3e service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a691c04-940f-4f7c-9d2b-9cd319087c16 req-0696771d-5f7e-4c62-960c-f140f48ccb3e service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a691c04-940f-4f7c-9d2b-9cd319087c16 req-0696771d-5f7e-4c62-960c-f140f48ccb3e service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:27 user nova-compute[76870]: WARNING nova.compute.manager [req-8a691c04-940f-4f7c-9d2b-9cd319087c16 req-0696771d-5f7e-4c62-960c-f140f48ccb3e service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state active and task_state powering-off.
Oct 20 14:42:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance destroyed successfully.
Oct 20 14:42:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:42:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed7ca875-2c42-4fd9-81d0-5b12249e4cfc tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.898s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-e517f41c-fab8-4b00-8040-a00d8d9e007a req-628cd8a4-69a0-48cb-9ff0-9567b46e8359 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e517f41c-fab8-4b00-8040-a00d8d9e007a req-628cd8a4-69a0-48cb-9ff0-9567b46e8359 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e517f41c-fab8-4b00-8040-a00d8d9e007a req-628cd8a4-69a0-48cb-9ff0-9567b46e8359 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e517f41c-fab8-4b00-8040-a00d8d9e007a req-628cd8a4-69a0-48cb-9ff0-9567b46e8359 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-e517f41c-fab8-4b00-8040-a00d8d9e007a req-628cd8a4-69a0-48cb-9ff0-9567b46e8359 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:29 user nova-compute[76870]: WARNING nova.compute.manager [req-e517f41c-fab8-4b00-8040-a00d8d9e007a req-628cd8a4-69a0-48cb-9ff0-9567b46e8359 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state stopped and task_state None.
Oct 20 14:42:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:42:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG nova.objects.instance [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'flavor' on Instance uuid f5f46d70-69fc-4985-ae20-1676a0efd8d0 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:36 user nova-compute[76870]: INFO nova.compute.manager [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Attaching volume c6c61f6a-e237-4378-b1ce-f8facab8259b to /dev/vdb
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG os_brick.utils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1db18e-2a2b-46da-8486-d88aea5d1419]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d96f88-c8f6-4c74-84cb-60dd64498e34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a79e1-1094-4b49-9eec-20b8c329e74b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb7e3e-b3c7-4563-bcba-81a20b00011f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:42:36 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ea485-d449-4429-aaa0-e7229b81c111]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG os_brick.utils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Updating existing volume attachment record: ec28741d-876b-47d6-a2ae-bde2d53d8cf2 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-changed-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Refreshing instance network info cache due to event network-changed-623b384d-045a-4a86-9b9b-d4432a52555f. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] Acquiring lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] Acquired lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Refreshing network info cache for port 623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "interface-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "interface-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'flavor' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updated VIF entry in instance network info cache for port 623b384d-045a-4a86-9b9b-d4432a52555f. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e00a44a2-a343-41ff-a8c0-f1157d3f03e7 req-1750ee4c-810c-4d71-bbfa-ee92262a58cb service nova] Releasing lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'pci_requests' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.objects.base [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Object Instance<7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7> lazy-loaded attributes: flavor,pci_requests {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:42:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG nova.policy [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26a1441e1a3140d29da68799c0207d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d26bb4eb934036b1ea3cc48b16ed42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Successfully created port: a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:42:39 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:42:39 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7680MB free_disk=25.05886459350586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f46d70-69fc-4985-ae20-1676a0efd8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e93e28f1-7490-49d3-80a9-a2536b293f32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 844f56f6-be92-4c0b-88a9-55a82b330646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Successfully updated port: a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquired lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-changed-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Refreshing instance network info cache due to event network-changed-a58d5a1c-7d41-4909-aa28-b25cc621f1b1. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:42:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] Acquiring lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Releasing lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] Acquired lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.neutron [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Refreshing network info cache for port a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG os_vif [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72690656-c18d-5938-8754-74cb7ed18545', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa58d5a1c-7d, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa58d5a1c-7d, col_values=(('qos', UUID('3f9d1df4-d970-4ab0-9b26-f5e71464a3cc')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa58d5a1c-7d, col_values=(('external_ids', {'iface-id': 'a58d5a1c-7d41-4909-aa28-b25cc621f1b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:38:17', 'vm-uuid': '7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:40 user nova-compute[76870]: INFO os_vif [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d')
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] attach device xml: <interface type="ethernet">
Oct 20 14:42:40 user nova-compute[76870]:   <mac address="fa:16:3e:1c:38:17"/>
Oct 20 14:42:40 user nova-compute[76870]:   <model type="virtio"/>
Oct 20 14:42:40 user nova-compute[76870]:   <mtu size="1442"/>
Oct 20 14:42:40 user nova-compute[76870]:   <target dev="tapa58d5a1c-7d"/>
Oct 20 14:42:40 user nova-compute[76870]: </interface>
Oct 20 14:42:40 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-d36c4eea-9f97-44c6-a8ca-5432fa0800f0 req-24053936-3b6e-433f-a9b8-ee738db9f173 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d36c4eea-9f97-44c6-a8ca-5432fa0800f0 req-24053936-3b6e-433f-a9b8-ee738db9f173 service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d36c4eea-9f97-44c6-a8ca-5432fa0800f0 req-24053936-3b6e-433f-a9b8-ee738db9f173 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d36c4eea-9f97-44c6-a8ca-5432fa0800f0 req-24053936-3b6e-433f-a9b8-ee738db9f173 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-d36c4eea-9f97-44c6-a8ca-5432fa0800f0 req-24053936-3b6e-433f-a9b8-ee738db9f173 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:41 user nova-compute[76870]: WARNING nova.compute.manager [req-d36c4eea-9f97-44c6-a8ca-5432fa0800f0 req-24053936-3b6e-433f-a9b8-ee738db9f173 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 for instance with vm_state active and task_state None.
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No BDM found with device name hda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No VIF found with MAC fa:16:3e:23:7d:66, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:42:41 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:42:41 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:42:41 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:42:41</nova:creationTime>
Oct 20 14:42:41 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:42:41 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:42:41 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:42:41 user nova-compute[76870]:   <nova:owner>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:42:41 user nova-compute[76870]:   </nova:owner>
Oct 20 14:42:41 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:42:41 user nova-compute[76870]:   <nova:ports>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:42:41 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:42:41 user nova-compute[76870]:     </nova:port>
Oct 20 14:42:41 user nova-compute[76870]:     <nova:port uuid="a58d5a1c-7d41-4909-aa28-b25cc621f1b1">
Oct 20 14:42:41 user nova-compute[76870]:       <nova:ip type="fixed" address="10.10.10.211" ipVersion="4"/>
Oct 20 14:42:41 user nova-compute[76870]:     </nova:port>
Oct 20 14:42:41 user nova-compute[76870]:   </nova:ports>
Oct 20 14:42:41 user nova-compute[76870]: </nova:instance>
Oct 20 14:42:41 user nova-compute[76870]:  {{(pid=76870) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-deee8721-2fdc-4226-9c54-d40bbf4ea758 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "interface-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.940s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'flavor' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG nova.network.neutron [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updated VIF entry in instance network info cache for port a58d5a1c-7d41-4909-aa28-b25cc621f1b1. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG nova.network.neutron [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:42 user nova-compute[76870]: INFO nova.compute.manager [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Attaching volume 23074ded-8984-4ce0-bf72-0d2a9026f6b6 to /dev/vdb
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-179939b6-6005-494a-a2a8-8d0b20ef5893 req-20fd486a-0149-4384-9040-bffdbdd23398 service nova] Releasing lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG os_brick.utils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c724f4-5c86-4010-836f-4668be21ecb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5bd498-1eb5-4881-9d4e-fb89b28dfe7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96860b6-963b-4e09-9046-d68156b6b769]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9735f-0bc7-40d7-8485-4fcb5c92794c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:42:42 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:42:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c75fd-d63c-4647-bb1f-92cfe3f0afd5]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG os_brick.utils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:42:42 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating existing volume attachment record: 2f5e7f7a-e439-4865-a510-05ebf8cbf07b {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "682be055-2825-4360-b0a0-eeecce00e7e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:42:43 user nova-compute[76870]: INFO nova.compute.claims [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Claim successful on node user
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-5897812e-be76-4be7-8438-f660cb653aba req-5c066fd0-482f-4219-9324-0bcbad45da83 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5897812e-be76-4be7-8438-f660cb653aba req-5c066fd0-482f-4219-9324-0bcbad45da83 service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5897812e-be76-4be7-8438-f660cb653aba req-5c066fd0-482f-4219-9324-0bcbad45da83 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5897812e-be76-4be7-8438-f660cb653aba req-5c066fd0-482f-4219-9324-0bcbad45da83 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-5897812e-be76-4be7-8438-f660cb653aba req-5c066fd0-482f-4219-9324-0bcbad45da83 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:43 user nova-compute[76870]: WARNING nova.compute.manager [req-5897812e-be76-4be7-8438-f660cb653aba req-5c066fd0-482f-4219-9324-0bcbad45da83 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 for instance with vm_state active and task_state None.
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.network.neutron [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:42:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.policy [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41ffa7bfd51042efb29a472a9aabfbf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705d22169e9d4c33beaba01971d0e10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:42:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Creating image(s)
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "/opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "/opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "/opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:44 user nova-compute[76870]: INFO nova.compute.manager [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Terminating instance
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk 1073741824" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Successfully created port: 44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-65808c11-2064-4f4b-abd5-a3999bdf05e2 req-e5197432-f7ad-4642-9498-8f9bf83ab832 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-unplugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-65808c11-2064-4f4b-abd5-a3999bdf05e2 req-e5197432-f7ad-4642-9498-8f9bf83ab832 service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-65808c11-2064-4f4b-abd5-a3999bdf05e2 req-e5197432-f7ad-4642-9498-8f9bf83ab832 service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-65808c11-2064-4f4b-abd5-a3999bdf05e2 req-e5197432-f7ad-4642-9498-8f9bf83ab832 service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-65808c11-2064-4f4b-abd5-a3999bdf05e2 req-e5197432-f7ad-4642-9498-8f9bf83ab832 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-unplugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-65808c11-2064-4f4b-abd5-a3999bdf05e2 req-e5197432-f7ad-4642-9498-8f9bf83ab832 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-unplugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Cannot resize image /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Ensure instance console log exists: /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Instance destroyed successfully.
Oct 20 14:42:44 user nova-compute[76870]: DEBUG nova.objects.instance [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lazy-loading 'resources' on Instance uuid e93e28f1-7490-49d3-80a9-a2536b293f32 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-146034572',display_name='tempest-ServersNegativeTestJSON-server-146034572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-146034572',id=22,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba769d3e66645dcabea5000576ab8d5',ramdisk_id='',reservation_id='r-0g4cyqp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2069808',owner_user_name='tempest-ServersNegativeTestJSON-2069808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:41:02Z,user_data=None,user_id='72ae5e79e17d464bbdb1ad94786a845e',uuid=e93e28f1-7490-49d3-80a9-a2536b293f32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converting VIF {"id": "47e75c09-af03-481a-8fcc-020ffc4c6109", "address": "fa:16:3e:bd:2f:ab", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e75c09-af", "ovs_interfaceid": "47e75c09-af03-481a-8fcc-020ffc4c6109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG os_vif [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e75c09-af, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08d62c3f-ebac-4d86-b99f-798fef04b3d6) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: INFO os_vif [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=47e75c09-af03-481a-8fcc-020ffc4c6109,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e75c09-af')
Oct 20 14:42:45 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Deleting instance files /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32_del
Oct 20 14:42:45 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Deletion of /opt/stack/data/nova/instances/e93e28f1-7490-49d3-80a9-a2536b293f32_del complete
Oct 20 14:42:45 user nova-compute[76870]: INFO nova.compute.manager [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 20 14:42:45 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Successfully updated port: 44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "refresh_cache-682be055-2825-4360-b0a0-eeecce00e7e8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquired lock "refresh_cache-682be055-2825-4360-b0a0-eeecce00e7e8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-changed-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.compute.manager [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Refreshing instance network info cache due to event network-changed-44f026d1-28a4-4ce9-87f4-99616eb75183. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] Acquiring lock "refresh_cache-682be055-2825-4360-b0a0-eeecce00e7e8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 is timed out.
Oct 20 14:42:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully detached device vdb from instance c298bfea-a5c5-44a4-a4fd-508f199f46a7 from the live domain config.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPOdbjEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447d72d-9bc1-467a-a90b-e173df5c9134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:42:46 user nova-compute[76870]: No targets found.
Oct 20 14:42:46 user nova-compute[76870]: iSNS:
Oct 20 14:42:46 user nova-compute[76870]: No targets found.
Oct 20 14:42:46 user nova-compute[76870]: STATIC:
Oct 20 14:42:46 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94
Oct 20 14:42:46 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:46 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:46 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440
Oct 20 14:42:46 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:46 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:46 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e
Oct 20 14:42:46 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:42:46 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:42:46 user nova-compute[76870]: FIRMWARE:
Oct 20 14:42:46 user nova-compute[76870]: No targets found.
Oct 20 14:42:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:42:46 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:42:46 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[85797d61-fdfe-4306-8636-f897af3a3fc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[154cabf5-d84c-4847-9243-60e29a58df03]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:46 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:46 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:42:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e (non-flash)
Oct 20 14:42:46 user nova-compute[76870]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:42:46 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:42:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8495ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[578abcff-a524-44d7-af7a-b943e55d7cae]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dd7315-093b-41ff-b7e0-15ee966da4aa]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Updating instance_info_cache with network_info: [{"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f81cc6d-32d4-44aa-95d6-f3dc4a41e510]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Releasing lock "refresh_cache-682be055-2825-4360-b0a0-eeecce00e7e8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Instance network_info: |[{"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] Acquired lock "refresh_cache-682be055-2825-4360-b0a0-eeecce00e7e8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Refreshing network info cache for port 44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Start _get_guest_xml network_info=[{"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fe1e3-2e8f-4ba8-8a61-5041d56e455a]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-56257863',display_name='tempest-VolumesActionsTest-instance-56257863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-56257863',id=23,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='705d22169e9d4c33beaba01971d0e10d',ramdisk_id='',reservation_id='r-cas9hef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1366356536',owner_user_name='tempest-VolumesActionsTest-1366356536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:42:44Z,user_data=None,user_id='41ffa7bfd51042efb29a472a9aabfbf1',uuid=682be055-2825-4360-b0a0-eeecce00e7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converting VIF {"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.objects.instance [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lazy-loading 'pci_devices' on Instance uuid 682be055-2825-4360-b0a0-eeecce00e7e8 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8924eee-4ba8-4584-a73c-3b51f90c1464]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Took 1.29 seconds to deallocate network for instance.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:42:46 user nova-compute[76870]:   <uuid>682be055-2825-4360-b0a0-eeecce00e7e8</uuid>
Oct 20 14:42:46 user nova-compute[76870]:   <name>instance-00000017</name>
Oct 20 14:42:46 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:42:46 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:42:46 user nova-compute[76870]:   <metadata>
Oct 20 14:42:46 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:42:46 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:42:46 user nova-compute[76870]:       <nova:name>tempest-VolumesActionsTest-instance-56257863</nova:name>
Oct 20 14:42:46 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:42:46</nova:creationTime>
Oct 20 14:42:46 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:42:46 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:42:46 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:42:46 user nova-compute[76870]:       <nova:owner>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:user uuid="41ffa7bfd51042efb29a472a9aabfbf1">tempest-VolumesActionsTest-1366356536-project-member</nova:user>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:project uuid="705d22169e9d4c33beaba01971d0e10d">tempest-VolumesActionsTest-1366356536</nova:project>
Oct 20 14:42:46 user nova-compute[76870]:       </nova:owner>
Oct 20 14:42:46 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:42:46 user nova-compute[76870]:       <nova:ports>
Oct 20 14:42:46 user nova-compute[76870]:         <nova:port uuid="44f026d1-28a4-4ce9-87f4-99616eb75183">
Oct 20 14:42:46 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 14:42:46 user nova-compute[76870]:         </nova:port>
Oct 20 14:42:46 user nova-compute[76870]:       </nova:ports>
Oct 20 14:42:46 user nova-compute[76870]:     </nova:instance>
Oct 20 14:42:46 user nova-compute[76870]:   </metadata>
Oct 20 14:42:46 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:42:46 user nova-compute[76870]:     <system>
Oct 20 14:42:46 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:42:46 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:42:46 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:42:46 user nova-compute[76870]:       <entry name="serial">682be055-2825-4360-b0a0-eeecce00e7e8</entry>
Oct 20 14:42:46 user nova-compute[76870]:       <entry name="uuid">682be055-2825-4360-b0a0-eeecce00e7e8</entry>
Oct 20 14:42:46 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:42:46 user nova-compute[76870]:     </system>
Oct 20 14:42:46 user nova-compute[76870]:   </sysinfo>
Oct 20 14:42:46 user nova-compute[76870]:   <os>
Oct 20 14:42:46 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:42:46 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:42:46 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:42:46 user nova-compute[76870]:   </os>
Oct 20 14:42:46 user nova-compute[76870]:   <features>
Oct 20 14:42:46 user nova-compute[76870]:     <acpi/>
Oct 20 14:42:46 user nova-compute[76870]:     <apic/>
Oct 20 14:42:46 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:42:46 user nova-compute[76870]:   </features>
Oct 20 14:42:46 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:42:46 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:42:46 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:42:46 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:42:46 user nova-compute[76870]:   </clock>
Oct 20 14:42:46 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:42:46 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:42:46 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:42:46 user nova-compute[76870]:   </cpu>
Oct 20 14:42:46 user nova-compute[76870]:   <devices>
Oct 20 14:42:46 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:42:46 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:42:46 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk"/>
Oct 20 14:42:46 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:42:46 user nova-compute[76870]:     </disk>
Oct 20 14:42:46 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:42:46 user nova-compute[76870]:       <mac address="fa:16:3e:ad:f9:3a"/>
Oct 20 14:42:46 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:42:46 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:42:46 user nova-compute[76870]:       <target dev="tap44f026d1-28"/>
Oct 20 14:42:46 user nova-compute[76870]:     </interface>
Oct 20 14:42:46 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:42:46 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/console.log" append="off"/>
Oct 20 14:42:46 user nova-compute[76870]:     </serial>
Oct 20 14:42:46 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:42:46 user nova-compute[76870]:     <video>
Oct 20 14:42:46 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:42:46 user nova-compute[76870]:     </video>
Oct 20 14:42:46 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:42:46 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:42:46 user nova-compute[76870]:     </rng>
Oct 20 14:42:46 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:42:46 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:42:46 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:42:46 user nova-compute[76870]:     </memballoon>
Oct 20 14:42:46 user nova-compute[76870]:   </devices>
Oct 20 14:42:46 user nova-compute[76870]: </domain>
Oct 20 14:42:46 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-56257863',display_name='tempest-VolumesActionsTest-instance-56257863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-56257863',id=23,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='705d22169e9d4c33beaba01971d0e10d',ramdisk_id='',reservation_id='r-cas9hef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1366356536',owner_user_name='tempest-VolumesActionsTest-1366356536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:42:44Z,user_data=None,user_id='41ffa7bfd51042efb29a472a9aabfbf1',uuid=682be055-2825-4360-b0a0-eeecce00e7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converting VIF {"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_vif [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baad6207-aa4a-5e19-9061-149f240fc63d', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44f026d1-28, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44f026d1-28, col_values=(('qos', UUID('0938be7f-0635-4f58-8308-bc35d2121a95')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44f026d1-28, col_values=(('external_ids', {'iface-id': '44f026d1-28a4-4ce9-87f4-99616eb75183', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:f9:3a', 'vm-uuid': '682be055-2825-4360-b0a0-eeecce00e7e8'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c992698-348a-4a93-b286-9846f74fdfe7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: INFO os_vif [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28')
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260]
Oct 20 14:42:46 user nova-compute[76870]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e, portal: 172.16.0.220,3260] successful.
Oct 20 14:42:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9ecac4-c368-4527-8cf0-8a5ba951696e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c2de51-0a9a-4ba1-bb0b-4242ba6e500a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== disconnect_volume: return (489ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] No VIF found with MAC fa:16:3e:ad:f9:3a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state deleted and task_state None.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state deleted and task_state None.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state deleted and task_state None.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-unplugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-unplugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-unplugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state deleted and task_state None.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Acquiring lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] No waiting events found dispatching network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:46 user nova-compute[76870]: WARNING nova.compute.manager [req-de10a41c-8403-4dde-8d82-1b5cfcf1024b req-266874c4-94d3-439c-b846-5901656b0d8c service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received unexpected event network-vif-plugged-47e75c09-af03-481a-8fcc-020ffc4c6109 for instance with vm_state deleted and task_state None.
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Updated VIF entry in instance network info cache for port 44f026d1-28a4-4ce9-87f4-99616eb75183. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Updating instance_info_cache with network_info: [{"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-13fe6d4f-abba-44b8-b33b-f4783ce020d5 req-34685511-17e4-4221-a02a-7eba57e6e42f service nova] Releasing lock "refresh_cache-682be055-2825-4360-b0a0-eeecce00e7e8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:42:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:47 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Deleted allocations for instance e93e28f1-7490-49d3-80a9-a2536b293f32
Oct 20 14:42:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-40be1f06-83f2-415f-afe5-91f3f6cf610e tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "e93e28f1-7490-49d3-80a9-a2536b293f32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid c298bfea-a5c5-44a4-a4fd-508f199f46a7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3e9c58ad-8262-4cca-9062-9f78bef1c950 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.976s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-5993b944-185a-4839-9691-cacc19c48e5d req-ad24baab-9f3c-4444-9136-466831e99228 service nova] [instance: e93e28f1-7490-49d3-80a9-a2536b293f32] Received event network-vif-deleted-47e75c09-af03-481a-8fcc-020ffc4c6109 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.volume.cinder [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Update attachment failed for attachment ec28741d-876b-47d6-a2ae-bde2d53d8cf2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-712ec279-d6ed-4f9b-b924-042bf661c958) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-712ec279-d6ed-4f9b-b924-042bf661c958)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Failed to attach c6c61f6a-e237-4378-b1ce-f8facab8259b at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-712ec279-d6ed-4f9b-b924-042bf661c958)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Traceback (most recent call last):
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     self._volume_attach(context, volume, connector, instance,
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     connection_info = volume_api.attachment_update(
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     res = method(self, ctx, *args, **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     with excutils.save_and_reraise_exception():
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     self.force_reraise()
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     raise self.value
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     return method.func(obj, *args, **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     return self.request(url, method, **kwargs)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0]     raise exceptions.from_response(resp, body)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-712ec279-d6ed-4f9b-b924-042bf661c958)
Oct 20 14:42:47 user nova-compute[76870]: ERROR nova.compute.manager [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] 
Oct 20 14:42:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.981s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server [None req-453e872a-8846-4631-b306-58f0afa5df97 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-712ec279-d6ed-4f9b-b924-042bf661c958)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-712ec279-d6ed-4f9b-b924-042bf661c958)
Oct 20 14:42:48 user nova-compute[76870]: ERROR oslo_messaging.rpc.server 
Oct 20 14:42:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] No waiting events found dispatching network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:48 user nova-compute[76870]: WARNING nova.compute.manager [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received unexpected event network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 for instance with vm_state building and task_state spawning.
Oct 20 14:42:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] No waiting events found dispatching network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:48 user nova-compute[76870]: WARNING nova.compute.manager [req-086b85e4-3877-4f75-aa84-1559ab00640a req-92f0776a-d767-4b7b-b3b7-bae3aebc6dc3 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received unexpected event network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 for instance with vm_state building and task_state spawning.
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:42:50 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Instance spawned successfully.
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:42:50 user nova-compute[76870]: INFO nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Took 6.29 seconds to spawn the instance on the hypervisor.
Oct 20 14:42:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:42:50 user nova-compute[76870]: INFO nova.compute.manager [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Took 7.21 seconds to build instance.
Oct 20 14:42:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-760370e2-2944-4711-968c-9d9218b242c8 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "682be055-2825-4360-b0a0-eeecce00e7e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.310s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:52 user nova-compute[76870]: INFO nova.compute.manager [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Unrescuing
Oct 20 14:42:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG nova.network.neutron [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG nova.objects.instance [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'flavor' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-c72a5824-7d62-40fd-931f-15d61910bcd0 req-5448e51a-fff7-437a-82fc-d19cc10cde2b service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c72a5824-7d62-40fd-931f-15d61910bcd0 req-5448e51a-fff7-437a-82fc-d19cc10cde2b service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c72a5824-7d62-40fd-931f-15d61910bcd0 req-5448e51a-fff7-437a-82fc-d19cc10cde2b service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c72a5824-7d62-40fd-931f-15d61910bcd0 req-5448e51a-fff7-437a-82fc-d19cc10cde2b service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-c72a5824-7d62-40fd-931f-15d61910bcd0 req-5448e51a-fff7-437a-82fc-d19cc10cde2b service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:53 user nova-compute[76870]: WARNING nova.compute.manager [req-c72a5824-7d62-40fd-931f-15d61910bcd0 req-5448e51a-fff7-437a-82fc-d19cc10cde2b service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:42:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance destroyed successfully.
Oct 20 14:42:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:55 user nova-compute[76870]: WARNING nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:42:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing instance network info cache due to event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updated VIF entry in instance network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing instance network info cache due to event network-changed-2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Acquiring lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Acquired lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Refreshing network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updated VIF entry in instance network info cache for port 2b5df74b-2f39-43d5-8bfa-c56de7663d71. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [{"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:42:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fa278cf9-7c83-4d20-b8d7-fdd901f8e393 req-536656f5-5e5f-45f1-9fe4-c29539de348f service nova] Releasing lock "refresh_cache-e51d3dd1-98b7-49ad-bacf-f76ae5961963" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:57 user nova-compute[76870]: WARNING nova.compute.manager [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:42:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:42:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:42:57 user nova-compute[76870]: WARNING nova.compute.manager [req-39e2976b-dad1-4d3a-b95b-602fe0dea250 req-4e3e8603-10db-44b8-93f0-1c760c413cce service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:42:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-06b5d7ff-163e-4a06-a94b-5a95dcb37501 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:42:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmFkjZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:43:08 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:43:08 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:43:08 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a084f6d5-214c-4c34-abf6-d24f090fa6d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:43:08 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46460fd-b246-4981-bcb0-a763357e1c96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6] added
Oct 20 14:43:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[be51365f-0b97-4cc0-bd44-abb0f1ecfc7e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af02d6-2210-4647-b2ad-e64da72d311b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxmFkjZr {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxmFkjZr" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[443801cd-3e74-4da1-8bbb-e5d21d9610d1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxmFkjZr'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[776f4f02-2cff-47c4-b4a7-87145f4061b2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ba829-c822-4767-9785-7075084e243b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[478801ae-d306-433c-b1d9-789e1cfc702b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260]
Oct 20 14:43:08 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260] successful.
Oct 20 14:43:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13c5309-7127-43a7-b44b-248b9a57197a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d29e7a-d981-469f-8e9e-aba5632a27c4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 (non-flash)
Oct 20 14:43:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06909596-96b3-4a32-b7c7-1375778b3c81]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:43:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmFkjZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:43:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:43:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23335613033316535', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:43:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335613033316535', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:43:09 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'flavor' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:43:09 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:09 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:43:09 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:43:09 user nova-compute[76870]:   <serial>23074ded-8984-4ce0-bf72-0d2a9026f6b6</serial>
Oct 20 14:43:09 user nova-compute[76870]: </disk>
Oct 20 14:43:09 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:43:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:43:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No BDM found with device name hda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:43:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] No VIF found with MAC fa:16:3e:23:7d:66, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:43:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a59c9067-d6be-4659-89e0-c8490361a31d tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.529s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:12 user nova-compute[76870]: INFO nova.compute.manager [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Detaching volume 23074ded-8984-4ce0-bf72-0d2a9026f6b6
Oct 20 14:43:12 user nova-compute[76870]: INFO nova.virt.block_device [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Attempting to driver detach volume 23074ded-8984-4ce0-bf72-0d2a9026f6b6 from mountpoint /dev/vdb
Oct 20 14:43:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Attempting to detach device vdb from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:43:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:43:12 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:12 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:43:12 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:43:12 user nova-compute[76870]:   <serial>23074ded-8984-4ce0-bf72-0d2a9026f6b6</serial>
Oct 20 14:43:12 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 14:43:12 user nova-compute[76870]: </disk>
Oct 20 14:43:12 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully detached device vdb from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the persistent domain config.
Oct 20 14:43:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:43:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:43:12 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:12 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:43:12 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:43:12 user nova-compute[76870]:   <serial>23074ded-8984-4ce0-bf72-0d2a9026f6b6</serial>
Oct 20 14:43:12 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 14:43:12 user nova-compute[76870]: </disk>
Oct 20 14:43:12 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:43:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:15 user nova-compute[76870]: INFO nova.compute.manager [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Terminating instance
Oct 20 14:43:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:43:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-26c1e0f5-c999-45e4-ad5f-ea0b4c5351f2 req-8ce6ceaa-93d7-4ef1-ad57-f5d771ef9cd9 service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-vif-unplugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-26c1e0f5-c999-45e4-ad5f-ea0b4c5351f2 req-8ce6ceaa-93d7-4ef1-ad57-f5d771ef9cd9 service nova] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-26c1e0f5-c999-45e4-ad5f-ea0b4c5351f2 req-8ce6ceaa-93d7-4ef1-ad57-f5d771ef9cd9 service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-26c1e0f5-c999-45e4-ad5f-ea0b4c5351f2 req-8ce6ceaa-93d7-4ef1-ad57-f5d771ef9cd9 service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-26c1e0f5-c999-45e4-ad5f-ea0b4c5351f2 req-8ce6ceaa-93d7-4ef1-ad57-f5d771ef9cd9 service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] No waiting events found dispatching network-vif-unplugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-26c1e0f5-c999-45e4-ad5f-ea0b4c5351f2 req-8ce6ceaa-93d7-4ef1-ad57-f5d771ef9cd9 service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-vif-unplugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Instance destroyed successfully.
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.objects.instance [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'resources' on Instance uuid c298bfea-a5c5-44a4-a4fd-508f199f46a7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-865937556',display_name='tempest-AttachVolumeNegativeTest-server-865937556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-865937556',id=16,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDpSTPNExYdLepONW6sPR4JlJOOrVasD5hp48/p4K6pLWLB8EzHXq6jkbWNIuOyvV/pUanwFWRKthlQRPrM4ZBDL867vNwVLSEyijBkUl/wXzZolvGnfUWmQMIrRnTk4g==',key_name='tempest-keypair-187291426',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-sou7ippw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=c298bfea-a5c5-44a4-a4fd-508f199f46a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "address": "fa:16:3e:5d:f5:6e", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb60e76-70", "ovs_interfaceid": "8eb60e76-707f-4c6b-b0fd-6de87abbc432", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG os_vif [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eb60e76-70, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57399c7b-6c4f-4e85-97c6-887203b128ee) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:16 user nova-compute[76870]: INFO os_vif [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:f5:6e,bridge_name='br-int',has_traffic_filtering=True,id=8eb60e76-707f-4c6b-b0fd-6de87abbc432,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb60e76-70')
Oct 20 14:43:16 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Deleting instance files /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7_del
Oct 20 14:43:16 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Deletion of /opt/stack/data/nova/instances/c298bfea-a5c5-44a4-a4fd-508f199f46a7_del complete
Oct 20 14:43:16 user nova-compute[76870]: INFO nova.compute.manager [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 14:43:16 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:43:16 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:43:17 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:43:17 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Took 0.97 seconds to deallocate network for instance.
Oct 20 14:43:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:18 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Deleted allocations for instance c298bfea-a5c5-44a4-a4fd-508f199f46a7
Oct 20 14:43:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] Acquiring lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] No waiting events found dispatching network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:43:18 user nova-compute[76870]: WARNING nova.compute.manager [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received unexpected event network-vif-plugged-8eb60e76-707f-4c6b-b0fd-6de87abbc432 for instance with vm_state deleted and task_state None.
Oct 20 14:43:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-d98718ba-e82a-4797-9622-eaf774008ef8 req-62efa911-6e53-455a-b4b0-68d56c062c0f service nova] [instance: c298bfea-a5c5-44a4-a4fd-508f199f46a7] Received event network-vif-deleted-8eb60e76-707f-4c6b-b0fd-6de87abbc432 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:43:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-28bfd9b7-6277-4185-b3c8-32a2dd2a9ee6 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "c298bfea-a5c5-44a4-a4fd-508f199f46a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:26 user nova-compute[76870]: INFO nova.compute.manager [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Detaching volume 105b8816-be28-469d-9f1c-81069ff42c94
Oct 20 14:43:26 user nova-compute[76870]: INFO nova.virt.block_device [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Attempting to driver detach volume 105b8816-be28-469d-9f1c-81069ff42c94 from mountpoint /dev/vdb
Oct 20 14:43:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Attempting to detach device vdb from instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:43:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:43:26 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:26 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:43:26 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:43:26 user nova-compute[76870]:   <serial>105b8816-be28-469d-9f1c-81069ff42c94</serial>
Oct 20 14:43:26 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:43:26 user nova-compute[76870]: </disk>
Oct 20 14:43:26 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:26 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Successfully detached device vdb from instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 from the persistent domain config.
Oct 20 14:43:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:43:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:43:26 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:26 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:43:26 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:43:26 user nova-compute[76870]:   <serial>105b8816-be28-469d-9f1c-81069ff42c94</serial>
Oct 20 14:43:26 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:43:26 user nova-compute[76870]: </disk>
Oct 20 14:43:26 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:43:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:27 user nova-compute[76870]: INFO nova.compute.manager [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Detaching volume 7edd0f47-e617-4667-a13b-d540627e4440
Oct 20 14:43:27 user nova-compute[76870]: INFO nova.virt.block_device [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Attempting to driver detach volume 7edd0f47-e617-4667-a13b-d540627e4440 from mountpoint /dev/vdc
Oct 20 14:43:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Attempting to detach device vdc from instance 844f56f6-be92-4c0b-88a9-55a82b330646 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:43:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:43:27 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:27 user nova-compute[76870]:   <source dev="/dev/sde"/>
Oct 20 14:43:27 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:43:27 user nova-compute[76870]:   <serial>7edd0f47-e617-4667-a13b-d540627e4440</serial>
Oct 20 14:43:27 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 14:43:27 user nova-compute[76870]: </disk>
Oct 20 14:43:27 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully detached device vdc from instance 844f56f6-be92-4c0b-88a9-55a82b330646 from the persistent domain config.
Oct 20 14:43:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 844f56f6-be92-4c0b-88a9-55a82b330646 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:43:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:43:27 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:43:27 user nova-compute[76870]:   <source dev="/dev/sde"/>
Oct 20 14:43:27 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:43:27 user nova-compute[76870]:   <serial>7edd0f47-e617-4667-a13b-d540627e4440</serial>
Oct 20 14:43:27 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 14:43:27 user nova-compute[76870]: </disk>
Oct 20 14:43:27 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:43:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:43:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:32 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 is timed out.
Oct 20 14:43:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully detached device vdb from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the live domain config.
Oct 20 14:43:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmFkjZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:43:32 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dbcf41-e9c6-409b-ad61-398f964e933b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:43:32 user nova-compute[76870]: No targets found.
Oct 20 14:43:32 user nova-compute[76870]: iSNS:
Oct 20 14:43:32 user nova-compute[76870]: No targets found.
Oct 20 14:43:32 user nova-compute[76870]: STATIC:
Oct 20 14:43:32 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94
Oct 20 14:43:32 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:43:32 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:43:32 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440
Oct 20 14:43:32 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:43:32 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:43:32 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6
Oct 20 14:43:32 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:43:32 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:43:32 user nova-compute[76870]: FIRMWARE:
Oct 20 14:43:32 user nova-compute[76870]: No targets found.
Oct 20 14:43:32 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:43:32 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:43:32 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8673501f-52b9-4e90-8d3e-60ec09db290b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f6f8ae-7f48-41c1-90e9-a70bfb06264e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:32 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:32 user nova-compute[76870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 (non-flash)
Oct 20 14:43:32 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:32 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:32 user nova-compute[76870]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 (non-flash)
Oct 20 14:43:32 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c78fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca1193d-b6a4-4bff-a753-6a02963e3306]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08098bf-85f5-4fc2-b06e-583411db2fc6]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06100639-d301-469c-8ce7-d8d4d3aff4f0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[068fa4d9-4193-41ff-92e1-5565a05dc40e]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910a7ab-a4d5-4f2e-8918-8b9098cef854]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d98019b-f324-4752-b042-d01577597cc7]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260]
Oct 20 14:43:32 user nova-compute[76870]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6, portal: 172.16.0.220,3260] successful.
Oct 20 14:43:32 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23074ded-8984-4ce0-bf72-0d2a9026f6b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d4fc39-b553-416b-a238-985a3dc8c439]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] <== disconnect_volume: return (301ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:43:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:43:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:43:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=25.081928253173828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'flavor' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78bcf9ff-3445-466d-b947-ab9f38516b87 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.354s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f46d70-69fc-4985-ae20-1676a0efd8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 844f56f6-be92-4c0b-88a9-55a82b330646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 682be055-2825-4360-b0a0-eeecce00e7e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "interface-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-a58d5a1c-7d41-4909-aa28-b25cc621f1b1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "interface-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-a58d5a1c-7d41-4909-aa28-b25cc621f1b1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'flavor' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface> {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface> {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Attempting to detach device tapa58d5a1c-7d from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] detach device xml: <interface type="ethernet">
Oct 20 14:43:38 user nova-compute[76870]:   <mac address="fa:16:3e:1c:38:17"/>
Oct 20 14:43:38 user nova-compute[76870]:   <model type="virtio"/>
Oct 20 14:43:38 user nova-compute[76870]:   <mtu size="1442"/>
Oct 20 14:43:38 user nova-compute[76870]:   <target dev="tapa58d5a1c-7d"/>
Oct 20 14:43:38 user nova-compute[76870]: </interface>
Oct 20 14:43:38 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface> {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface>not found in domain: <domain type='kvm' id='22'>
Oct 20 14:43:38 user nova-compute[76870]:   <name>instance-00000015</name>
Oct 20 14:43:38 user nova-compute[76870]:   <uuid>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</uuid>
Oct 20 14:43:38 user nova-compute[76870]:   <metadata>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:43:38 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:43:38 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:43:38 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:42:41</nova:creationTime>
Oct 20 14:43:38 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:43:38 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:43:38 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:43:38 user nova-compute[76870]:   <nova:owner>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:43:38 user nova-compute[76870]:   </nova:owner>
Oct 20 14:43:38 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:43:38 user nova-compute[76870]:   <nova:ports>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:43:38 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:43:38 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:38 user nova-compute[76870]:     <nova:port uuid="a58d5a1c-7d41-4909-aa28-b25cc621f1b1">
Oct 20 14:43:38 user nova-compute[76870]:       <nova:ip type="fixed" address="10.10.10.211" ipVersion="4"/>
Oct 20 14:43:38 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:38 user nova-compute[76870]:   </nova:ports>
Oct 20 14:43:38 user nova-compute[76870]: </nova:instance>
Oct 20 14:43:38 user nova-compute[76870]:   </metadata>
Oct 20 14:43:38 user nova-compute[76870]:   <memory unit='KiB'>524288</memory>
Oct 20 14:43:38 user nova-compute[76870]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 14:43:38 user nova-compute[76870]:   <vcpu placement='static'>1</vcpu>
Oct 20 14:43:38 user nova-compute[76870]:   <resource>
Oct 20 14:43:38 user nova-compute[76870]:     <partition>/machine</partition>
Oct 20 14:43:38 user nova-compute[76870]:   </resource>
Oct 20 14:43:38 user nova-compute[76870]:   <sysinfo type='smbios'>
Oct 20 14:43:38 user nova-compute[76870]:     <system>
Oct 20 14:43:38 user nova-compute[76870]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 14:43:38 user nova-compute[76870]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 14:43:38 user nova-compute[76870]:       <entry name='version'>0.0.0</entry>
Oct 20 14:43:38 user nova-compute[76870]:       <entry name='serial'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:38 user nova-compute[76870]:       <entry name='uuid'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:38 user nova-compute[76870]:       <entry name='family'>Virtual Machine</entry>
Oct 20 14:43:38 user nova-compute[76870]:     </system>
Oct 20 14:43:38 user nova-compute[76870]:   </sysinfo>
Oct 20 14:43:38 user nova-compute[76870]:   <os>
Oct 20 14:43:38 user nova-compute[76870]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 14:43:38 user nova-compute[76870]:     <boot dev='hd'/>
Oct 20 14:43:38 user nova-compute[76870]:     <smbios mode='sysinfo'/>
Oct 20 14:43:38 user nova-compute[76870]:   </os>
Oct 20 14:43:38 user nova-compute[76870]:   <features>
Oct 20 14:43:38 user nova-compute[76870]:     <acpi/>
Oct 20 14:43:38 user nova-compute[76870]:     <apic/>
Oct 20 14:43:38 user nova-compute[76870]:     <vmcoreinfo state='on'/>
Oct 20 14:43:38 user nova-compute[76870]:   </features>
Oct 20 14:43:38 user nova-compute[76870]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 14:43:38 user nova-compute[76870]:     <model fallback='forbid'>Nehalem</model>
Oct 20 14:43:38 user nova-compute[76870]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 14:43:38 user nova-compute[76870]:     <feature policy='require' name='vme'/>
Oct 20 14:43:38 user nova-compute[76870]:     <feature policy='require' name='x2apic'/>
Oct 20 14:43:38 user nova-compute[76870]:     <feature policy='require' name='hypervisor'/>
Oct 20 14:43:38 user nova-compute[76870]:   </cpu>
Oct 20 14:43:38 user nova-compute[76870]:   <clock offset='utc'>
Oct 20 14:43:38 user nova-compute[76870]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 14:43:38 user nova-compute[76870]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 14:43:38 user nova-compute[76870]:     <timer name='hpet' present='no'/>
Oct 20 14:43:38 user nova-compute[76870]:   </clock>
Oct 20 14:43:38 user nova-compute[76870]:   <on_poweroff>destroy</on_poweroff>
Oct 20 14:43:38 user nova-compute[76870]:   <on_reboot>restart</on_reboot>
Oct 20 14:43:38 user nova-compute[76870]:   <on_crash>destroy</on_crash>
Oct 20 14:43:38 user nova-compute[76870]:   <devices>
Oct 20 14:43:38 user nova-compute[76870]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 14:43:38 user nova-compute[76870]:     <disk type='file' device='disk'>
Oct 20 14:43:38 user nova-compute[76870]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 14:43:38 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk' index='2'/>
Oct 20 14:43:38 user nova-compute[76870]:       <backingStore type='file' index='3'>
Oct 20 14:43:38 user nova-compute[76870]:         <format type='raw'/>
Oct 20 14:43:38 user nova-compute[76870]:         <source file='/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3'/>
Oct 20 14:43:38 user nova-compute[76870]:         <backingStore/>
Oct 20 14:43:38 user nova-compute[76870]:       </backingStore>
Oct 20 14:43:38 user nova-compute[76870]:       <target dev='vda' bus='virtio'/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='virtio-disk0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </disk>
Oct 20 14:43:38 user nova-compute[76870]:     <disk type='file' device='cdrom'>
Oct 20 14:43:38 user nova-compute[76870]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 14:43:38 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config' index='1'/>
Oct 20 14:43:38 user nova-compute[76870]:       <backingStore/>
Oct 20 14:43:38 user nova-compute[76870]:       <target dev='hda' bus='ide'/>
Oct 20 14:43:38 user nova-compute[76870]:       <readonly/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='ide0-0-0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </disk>
Oct 20 14:43:38 user nova-compute[76870]:     <controller type='usb' index='0' model='none'>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='usb'/>
Oct 20 14:43:38 user nova-compute[76870]:     </controller>
Oct 20 14:43:38 user nova-compute[76870]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='pci.0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </controller>
Oct 20 14:43:38 user nova-compute[76870]:     <controller type='ide' index='0'>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='ide'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 14:43:38 user nova-compute[76870]:     </controller>
Oct 20 14:43:38 user nova-compute[76870]:     <interface type='ethernet'>
Oct 20 14:43:38 user nova-compute[76870]:       <mac address='fa:16:3e:23:7d:66'/>
Oct 20 14:43:38 user nova-compute[76870]:       <target dev='tap623b384d-04'/>
Oct 20 14:43:38 user nova-compute[76870]:       <model type='virtio'/>
Oct 20 14:43:38 user nova-compute[76870]:       <mtu size='1442'/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='net0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </interface>
Oct 20 14:43:38 user nova-compute[76870]:     <interface type='ethernet'>
Oct 20 14:43:38 user nova-compute[76870]:       <mac address='fa:16:3e:1c:38:17'/>
Oct 20 14:43:38 user nova-compute[76870]:       <target dev='tapa58d5a1c-7d'/>
Oct 20 14:43:38 user nova-compute[76870]:       <model type='virtio'/>
Oct 20 14:43:38 user nova-compute[76870]:       <mtu size='1442'/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='net1'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </interface>
Oct 20 14:43:38 user nova-compute[76870]:     <serial type='pty'>
Oct 20 14:43:38 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:38 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:38 user nova-compute[76870]:       <target type='isa-serial' port='0'>
Oct 20 14:43:38 user nova-compute[76870]:         <model name='isa-serial'/>
Oct 20 14:43:38 user nova-compute[76870]:       </target>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </serial>
Oct 20 14:43:38 user nova-compute[76870]:     <console type='pty' tty='/dev/pts/8'>
Oct 20 14:43:38 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:38 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:38 user nova-compute[76870]:       <target type='serial' port='0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </console>
Oct 20 14:43:38 user nova-compute[76870]:     <input type='mouse' bus='ps2'>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='input0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </input>
Oct 20 14:43:38 user nova-compute[76870]:     <input type='keyboard' bus='ps2'>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='input1'/>
Oct 20 14:43:38 user nova-compute[76870]:     </input>
Oct 20 14:43:38 user nova-compute[76870]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 20 14:43:38 user nova-compute[76870]:       <listen type='address' address='0.0.0.0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </graphics>
Oct 20 14:43:38 user nova-compute[76870]:     <audio id='1' type='none'/>
Oct 20 14:43:38 user nova-compute[76870]:     <video>
Oct 20 14:43:38 user nova-compute[76870]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='video0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </video>
Oct 20 14:43:38 user nova-compute[76870]:     <memballoon model='virtio'>
Oct 20 14:43:38 user nova-compute[76870]:       <stats period='10'/>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='balloon0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </memballoon>
Oct 20 14:43:38 user nova-compute[76870]:     <rng model='virtio'>
Oct 20 14:43:38 user nova-compute[76870]:       <backend model='random'>/dev/urandom</backend>
Oct 20 14:43:38 user nova-compute[76870]:       <alias name='rng0'/>
Oct 20 14:43:38 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 14:43:38 user nova-compute[76870]:     </rng>
Oct 20 14:43:38 user nova-compute[76870]:   </devices>
Oct 20 14:43:38 user nova-compute[76870]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 14:43:38 user nova-compute[76870]:     <label>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</label>
Oct 20 14:43:38 user nova-compute[76870]:     <imagelabel>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</imagelabel>
Oct 20 14:43:38 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:38 user nova-compute[76870]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 14:43:38 user nova-compute[76870]:     <label>+64055:+108</label>
Oct 20 14:43:38 user nova-compute[76870]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 14:43:38 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:38 user nova-compute[76870]: </domain>
Oct 20 14:43:38 user nova-compute[76870]:  {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 14:43:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully detached device tapa58d5a1c-7d from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the persistent domain config.
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] (1/8): Attempting to detach device tapa58d5a1c-7d with device alias net1 from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:43:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] detach device xml: <interface type="ethernet">
Oct 20 14:43:38 user nova-compute[76870]:   <mac address="fa:16:3e:1c:38:17"/>
Oct 20 14:43:38 user nova-compute[76870]:   <model type="virtio"/>
Oct 20 14:43:38 user nova-compute[76870]:   <mtu size="1442"/>
Oct 20 14:43:38 user nova-compute[76870]:   <target dev="tapa58d5a1c-7d"/>
Oct 20 14:43:38 user nova-compute[76870]: </interface>
Oct 20 14:43:38 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Start waiting for the detach event from libvirt for device tapa58d5a1c-7d with device alias net1 for instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-c6cf1d99-5a90-4756-82c3-326cba32b812 req-528e3dbd-6edb-4857-8844-497a00ee8f13 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-unplugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c6cf1d99-5a90-4756-82c3-326cba32b812 req-528e3dbd-6edb-4857-8844-497a00ee8f13 service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c6cf1d99-5a90-4756-82c3-326cba32b812 req-528e3dbd-6edb-4857-8844-497a00ee8f13 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c6cf1d99-5a90-4756-82c3-326cba32b812 req-528e3dbd-6edb-4857-8844-497a00ee8f13 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-c6cf1d99-5a90-4756-82c3-326cba32b812 req-528e3dbd-6edb-4857-8844-497a00ee8f13 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-unplugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:43:39 user nova-compute[76870]: WARNING nova.compute.manager [req-c6cf1d99-5a90-4756-82c3-326cba32b812 req-528e3dbd-6edb-4857-8844-497a00ee8f13 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-unplugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 for instance with vm_state active and task_state None.
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:43:39 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:43:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:43:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:43:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-256c51d3-ff0a-4410-8fea-d66a86105530 req-4954c842-9282-4f2a-b3be-49bcfe6b915a service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:43:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-256c51d3-ff0a-4410-8fea-d66a86105530 req-4954c842-9282-4f2a-b3be-49bcfe6b915a service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:43:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-256c51d3-ff0a-4410-8fea-d66a86105530 req-4954c842-9282-4f2a-b3be-49bcfe6b915a service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:43:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-256c51d3-ff0a-4410-8fea-d66a86105530 req-4954c842-9282-4f2a-b3be-49bcfe6b915a service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-256c51d3-ff0a-4410-8fea-d66a86105530 req-4954c842-9282-4f2a-b3be-49bcfe6b915a service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:43:41 user nova-compute[76870]: WARNING nova.compute.manager [req-256c51d3-ff0a-4410-8fea-d66a86105530 req-4954c842-9282-4f2a-b3be-49bcfe6b915a service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-plugged-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 for instance with vm_state active and task_state None.
Oct 20 14:43:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:43:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 is timed out.
Oct 20 14:43:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Successfully detached device vdb from instance e51d3dd1-98b7-49ad-bacf-f76ae5961963 from the live domain config.
Oct 20 14:43:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgoRqOdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:43:46 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a1cee-7943-42b7-8626-6d3fc706c95c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:43:46 user nova-compute[76870]: No targets found.
Oct 20 14:43:46 user nova-compute[76870]: iSNS:
Oct 20 14:43:46 user nova-compute[76870]: No targets found.
Oct 20 14:43:46 user nova-compute[76870]: STATIC:
Oct 20 14:43:46 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94
Oct 20 14:43:46 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:43:46 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:43:46 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440
Oct 20 14:43:46 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:43:46 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:43:46 user nova-compute[76870]: FIRMWARE:
Oct 20 14:43:46 user nova-compute[76870]: No targets found.
Oct 20 14:43:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:43:46 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:43:46 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee8e7e5-35f9-4b85-b5fa-499192783b30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca21297-d803-4895-8c3c-e86b271c6a64]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:46 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 (non-flash)
Oct 20 14:43:46 user nova-compute[76870]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8455d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49654b0-f014-489c-b0b1-d073a6fca6c6]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff733772-27cd-4707-bb9d-6beb5683a8a2]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d3e0aa-dd7c-4ea9-a2da-5f37d9a5548a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff4884e-83db-4d8d-ad60-180a6dad5549]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dad60b9-57e9-4446-b1f1-bfd2f2b48274]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda3d542-dda0-4b21-9be8-20e056c26551]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260]
Oct 20 14:43:46 user nova-compute[76870]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94, portal: 172.16.0.220,3260] successful.
Oct 20 14:43:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:105b8816-be28-469d-9f1c-81069ff42c94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6e04b-ff43-470c-b57b-59a543e56135]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] <== disconnect_volume: return (275ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:43:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'flavor' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ed0191-13c8-420b-a3c1-04049ef76327 tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:47 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 844f56f6-be92-4c0b-88a9-55a82b330646 is timed out.
Oct 20 14:43:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully detached device vdc from instance 844f56f6-be92-4c0b-88a9-55a82b330646 from the live domain config.
Oct 20 14:43:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghMeQsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:43:47 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[56382b09-4e85-4069-a0b3-49ee8d815006]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:43:47 user nova-compute[76870]: No targets found.
Oct 20 14:43:47 user nova-compute[76870]: iSNS:
Oct 20 14:43:47 user nova-compute[76870]: No targets found.
Oct 20 14:43:47 user nova-compute[76870]: STATIC:
Oct 20 14:43:47 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440
Oct 20 14:43:47 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:43:47 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:43:47 user nova-compute[76870]: FIRMWARE:
Oct 20 14:43:47 user nova-compute[76870]: No targets found.
Oct 20 14:43:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:43:47 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:43:47 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed2451-6b6b-4e5e-9f2d-7ad985f70a27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42fb74c-c69b-4224-9ad0-09d518b9e9da]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 (non-flash)
Oct 20 14:43:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c1c1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440'): ({'sde'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Removing single pathed devices sde {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d33217-be0b-417b-a9fd-2c1b56513b33]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7522fc-7bdf-490f-af34-73f10b0f4a6d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flushing IO for device /dev/sde {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:43:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15c7b47-8324-40a3-a116-1c4328e817e1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[258f8284-93e7-4704-85d9-e1e314cc2d50]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[87188f79-7cf3-44cb-bba0-057b0100866d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94738262-6034-409a-9843-11b84f84db05]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260]
Oct 20 14:43:48 user nova-compute[76870]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440, portal: 172.16.0.220,3260] successful.
Oct 20 14:43:48 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edd0f47-e617-4667-a13b-d540627e4440 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5514223a-8ced-4084-9632-b27445f5cfa2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] <== disconnect_volume: return (266ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:43:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:43:49 user nova-compute[76870]: DEBUG nova.objects.instance [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'flavor' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-445b16ff-fc65-4f0c-89fb-d4ea77de6099 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:43:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:43:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:43:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:43:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Waiting for libvirt event about the detach of device tapa58d5a1c-7d with device alias net1 from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 is timed out.
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface> {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface>not found in domain: <domain type='kvm' id='22'>
Oct 20 14:43:59 user nova-compute[76870]:   <name>instance-00000015</name>
Oct 20 14:43:59 user nova-compute[76870]:   <uuid>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</uuid>
Oct 20 14:43:59 user nova-compute[76870]:   <metadata>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:43:59 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:42:41</nova:creationTime>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:43:59 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:ports>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:43:59 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:43:59 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:port uuid="a58d5a1c-7d41-4909-aa28-b25cc621f1b1">
Oct 20 14:43:59 user nova-compute[76870]:       <nova:ip type="fixed" address="10.10.10.211" ipVersion="4"/>
Oct 20 14:43:59 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:ports>
Oct 20 14:43:59 user nova-compute[76870]: </nova:instance>
Oct 20 14:43:59 user nova-compute[76870]:   </metadata>
Oct 20 14:43:59 user nova-compute[76870]:   <memory unit='KiB'>524288</memory>
Oct 20 14:43:59 user nova-compute[76870]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 14:43:59 user nova-compute[76870]:   <vcpu placement='static'>1</vcpu>
Oct 20 14:43:59 user nova-compute[76870]:   <resource>
Oct 20 14:43:59 user nova-compute[76870]:     <partition>/machine</partition>
Oct 20 14:43:59 user nova-compute[76870]:   </resource>
Oct 20 14:43:59 user nova-compute[76870]:   <sysinfo type='smbios'>
Oct 20 14:43:59 user nova-compute[76870]:     <system>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='version'>0.0.0</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='serial'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='uuid'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='family'>Virtual Machine</entry>
Oct 20 14:43:59 user nova-compute[76870]:     </system>
Oct 20 14:43:59 user nova-compute[76870]:   </sysinfo>
Oct 20 14:43:59 user nova-compute[76870]:   <os>
Oct 20 14:43:59 user nova-compute[76870]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 14:43:59 user nova-compute[76870]:     <boot dev='hd'/>
Oct 20 14:43:59 user nova-compute[76870]:     <smbios mode='sysinfo'/>
Oct 20 14:43:59 user nova-compute[76870]:   </os>
Oct 20 14:43:59 user nova-compute[76870]:   <features>
Oct 20 14:43:59 user nova-compute[76870]:     <acpi/>
Oct 20 14:43:59 user nova-compute[76870]:     <apic/>
Oct 20 14:43:59 user nova-compute[76870]:     <vmcoreinfo state='on'/>
Oct 20 14:43:59 user nova-compute[76870]:   </features>
Oct 20 14:43:59 user nova-compute[76870]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 14:43:59 user nova-compute[76870]:     <model fallback='forbid'>Nehalem</model>
Oct 20 14:43:59 user nova-compute[76870]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='vme'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='x2apic'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='hypervisor'/>
Oct 20 14:43:59 user nova-compute[76870]:   </cpu>
Oct 20 14:43:59 user nova-compute[76870]:   <clock offset='utc'>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='hpet' present='no'/>
Oct 20 14:43:59 user nova-compute[76870]:   </clock>
Oct 20 14:43:59 user nova-compute[76870]:   <on_poweroff>destroy</on_poweroff>
Oct 20 14:43:59 user nova-compute[76870]:   <on_reboot>restart</on_reboot>
Oct 20 14:43:59 user nova-compute[76870]:   <on_crash>destroy</on_crash>
Oct 20 14:43:59 user nova-compute[76870]:   <devices>
Oct 20 14:43:59 user nova-compute[76870]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 14:43:59 user nova-compute[76870]:     <disk type='file' device='disk'>
Oct 20 14:43:59 user nova-compute[76870]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 14:43:59 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk' index='2'/>
Oct 20 14:43:59 user nova-compute[76870]:       <backingStore type='file' index='3'>
Oct 20 14:43:59 user nova-compute[76870]:         <format type='raw'/>
Oct 20 14:43:59 user nova-compute[76870]:         <source file='/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3'/>
Oct 20 14:43:59 user nova-compute[76870]:         <backingStore/>
Oct 20 14:43:59 user nova-compute[76870]:       </backingStore>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='vda' bus='virtio'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='virtio-disk0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </disk>
Oct 20 14:43:59 user nova-compute[76870]:     <disk type='file' device='cdrom'>
Oct 20 14:43:59 user nova-compute[76870]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 14:43:59 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config' index='1'/>
Oct 20 14:43:59 user nova-compute[76870]:       <backingStore/>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='hda' bus='ide'/>
Oct 20 14:43:59 user nova-compute[76870]:       <readonly/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='ide0-0-0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </disk>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='usb' index='0' model='none'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='usb'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='pci.0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='ide' index='0'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='ide'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <interface type='ethernet'>
Oct 20 14:43:59 user nova-compute[76870]:       <mac address='fa:16:3e:23:7d:66'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='tap623b384d-04'/>
Oct 20 14:43:59 user nova-compute[76870]:       <model type='virtio'/>
Oct 20 14:43:59 user nova-compute[76870]:       <mtu size='1442'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='net0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </interface>
Oct 20 14:43:59 user nova-compute[76870]:     <serial type='pty'>
Oct 20 14:43:59 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:59 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target type='isa-serial' port='0'>
Oct 20 14:43:59 user nova-compute[76870]:         <model name='isa-serial'/>
Oct 20 14:43:59 user nova-compute[76870]:       </target>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </serial>
Oct 20 14:43:59 user nova-compute[76870]:     <console type='pty' tty='/dev/pts/8'>
Oct 20 14:43:59 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:59 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target type='serial' port='0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </console>
Oct 20 14:43:59 user nova-compute[76870]:     <input type='mouse' bus='ps2'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='input0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </input>
Oct 20 14:43:59 user nova-compute[76870]:     <input type='keyboard' bus='ps2'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='input1'/>
Oct 20 14:43:59 user nova-compute[76870]:     </input>
Oct 20 14:43:59 user nova-compute[76870]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 20 14:43:59 user nova-compute[76870]:       <listen type='address' address='0.0.0.0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </graphics>
Oct 20 14:43:59 user nova-compute[76870]:     <audio id='1' type='none'/>
Oct 20 14:43:59 user nova-compute[76870]:     <video>
Oct 20 14:43:59 user nova-compute[76870]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='video0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </video>
Oct 20 14:43:59 user nova-compute[76870]:     <memballoon model='virtio'>
Oct 20 14:43:59 user nova-compute[76870]:       <stats period='10'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='balloon0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </memballoon>
Oct 20 14:43:59 user nova-compute[76870]:     <rng model='virtio'>
Oct 20 14:43:59 user nova-compute[76870]:       <backend model='random'>/dev/urandom</backend>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='rng0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </rng>
Oct 20 14:43:59 user nova-compute[76870]:   </devices>
Oct 20 14:43:59 user nova-compute[76870]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 14:43:59 user nova-compute[76870]:     <label>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</label>
Oct 20 14:43:59 user nova-compute[76870]:     <imagelabel>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</imagelabel>
Oct 20 14:43:59 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:59 user nova-compute[76870]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 14:43:59 user nova-compute[76870]:     <label>+64055:+108</label>
Oct 20 14:43:59 user nova-compute[76870]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 14:43:59 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:59 user nova-compute[76870]: </domain>
Oct 20 14:43:59 user nova-compute[76870]:  {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 14:43:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully detached device tapa58d5a1c-7d from instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 from the live domain config.
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG os_vif [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa58d5a1c-7d, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f9d1df4-d970-4ab0-9b26-f5e71464a3cc) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: INFO os_vif [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d')
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:43:59 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:43:59</nova:creationTime>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:43:59 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:ports>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:43:59 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:43:59 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:ports>
Oct 20 14:43:59 user nova-compute[76870]: </nova:instance>
Oct 20 14:43:59 user nova-compute[76870]:  {{(pid=76870) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.compute.manager [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-deleted-a58d5a1c-7d41-4909-aa28-b25cc621f1b1 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:43:59 user nova-compute[76870]: INFO nova.compute.manager [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Neutron deleted interface a58d5a1c-7d41-4909-aa28-b25cc621f1b1; detaching it from the instance and deleting it from the info cache
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.neutron [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquired lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.objects.instance [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Lazy-loading 'system_metadata' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.objects.instance [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Lazy-loading 'flavor' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.objects.base [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Object Instance<7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7> lazy-loaded attributes: system_metadata,flavor {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Converting VIF {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface> {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface>not found in domain: <domain type='kvm' id='22'>
Oct 20 14:43:59 user nova-compute[76870]:   <name>instance-00000015</name>
Oct 20 14:43:59 user nova-compute[76870]:   <uuid>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</uuid>
Oct 20 14:43:59 user nova-compute[76870]:   <metadata>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:43:59 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:43:59</nova:creationTime>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:43:59 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:ports>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:43:59 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:43:59 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:ports>
Oct 20 14:43:59 user nova-compute[76870]: </nova:instance>
Oct 20 14:43:59 user nova-compute[76870]:   </metadata>
Oct 20 14:43:59 user nova-compute[76870]:   <memory unit='KiB'>524288</memory>
Oct 20 14:43:59 user nova-compute[76870]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 14:43:59 user nova-compute[76870]:   <vcpu placement='static'>1</vcpu>
Oct 20 14:43:59 user nova-compute[76870]:   <resource>
Oct 20 14:43:59 user nova-compute[76870]:     <partition>/machine</partition>
Oct 20 14:43:59 user nova-compute[76870]:   </resource>
Oct 20 14:43:59 user nova-compute[76870]:   <sysinfo type='smbios'>
Oct 20 14:43:59 user nova-compute[76870]:     <system>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='version'>0.0.0</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='serial'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='uuid'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='family'>Virtual Machine</entry>
Oct 20 14:43:59 user nova-compute[76870]:     </system>
Oct 20 14:43:59 user nova-compute[76870]:   </sysinfo>
Oct 20 14:43:59 user nova-compute[76870]:   <os>
Oct 20 14:43:59 user nova-compute[76870]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 14:43:59 user nova-compute[76870]:     <boot dev='hd'/>
Oct 20 14:43:59 user nova-compute[76870]:     <smbios mode='sysinfo'/>
Oct 20 14:43:59 user nova-compute[76870]:   </os>
Oct 20 14:43:59 user nova-compute[76870]:   <features>
Oct 20 14:43:59 user nova-compute[76870]:     <acpi/>
Oct 20 14:43:59 user nova-compute[76870]:     <apic/>
Oct 20 14:43:59 user nova-compute[76870]:     <vmcoreinfo state='on'/>
Oct 20 14:43:59 user nova-compute[76870]:   </features>
Oct 20 14:43:59 user nova-compute[76870]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 14:43:59 user nova-compute[76870]:     <model fallback='forbid'>Nehalem</model>
Oct 20 14:43:59 user nova-compute[76870]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='vme'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='x2apic'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='hypervisor'/>
Oct 20 14:43:59 user nova-compute[76870]:   </cpu>
Oct 20 14:43:59 user nova-compute[76870]:   <clock offset='utc'>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='hpet' present='no'/>
Oct 20 14:43:59 user nova-compute[76870]:   </clock>
Oct 20 14:43:59 user nova-compute[76870]:   <on_poweroff>destroy</on_poweroff>
Oct 20 14:43:59 user nova-compute[76870]:   <on_reboot>restart</on_reboot>
Oct 20 14:43:59 user nova-compute[76870]:   <on_crash>destroy</on_crash>
Oct 20 14:43:59 user nova-compute[76870]:   <devices>
Oct 20 14:43:59 user nova-compute[76870]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 14:43:59 user nova-compute[76870]:     <disk type='file' device='disk'>
Oct 20 14:43:59 user nova-compute[76870]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 14:43:59 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk' index='2'/>
Oct 20 14:43:59 user nova-compute[76870]:       <backingStore type='file' index='3'>
Oct 20 14:43:59 user nova-compute[76870]:         <format type='raw'/>
Oct 20 14:43:59 user nova-compute[76870]:         <source file='/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3'/>
Oct 20 14:43:59 user nova-compute[76870]:         <backingStore/>
Oct 20 14:43:59 user nova-compute[76870]:       </backingStore>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='vda' bus='virtio'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='virtio-disk0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </disk>
Oct 20 14:43:59 user nova-compute[76870]:     <disk type='file' device='cdrom'>
Oct 20 14:43:59 user nova-compute[76870]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 14:43:59 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config' index='1'/>
Oct 20 14:43:59 user nova-compute[76870]:       <backingStore/>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='hda' bus='ide'/>
Oct 20 14:43:59 user nova-compute[76870]:       <readonly/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='ide0-0-0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </disk>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='usb' index='0' model='none'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='usb'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='pci.0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='ide' index='0'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='ide'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <interface type='ethernet'>
Oct 20 14:43:59 user nova-compute[76870]:       <mac address='fa:16:3e:23:7d:66'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='tap623b384d-04'/>
Oct 20 14:43:59 user nova-compute[76870]:       <model type='virtio'/>
Oct 20 14:43:59 user nova-compute[76870]:       <mtu size='1442'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='net0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </interface>
Oct 20 14:43:59 user nova-compute[76870]:     <serial type='pty'>
Oct 20 14:43:59 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:59 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target type='isa-serial' port='0'>
Oct 20 14:43:59 user nova-compute[76870]:         <model name='isa-serial'/>
Oct 20 14:43:59 user nova-compute[76870]:       </target>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </serial>
Oct 20 14:43:59 user nova-compute[76870]:     <console type='pty' tty='/dev/pts/8'>
Oct 20 14:43:59 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:59 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target type='serial' port='0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </console>
Oct 20 14:43:59 user nova-compute[76870]:     <input type='mouse' bus='ps2'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='input0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </input>
Oct 20 14:43:59 user nova-compute[76870]:     <input type='keyboard' bus='ps2'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='input1'/>
Oct 20 14:43:59 user nova-compute[76870]:     </input>
Oct 20 14:43:59 user nova-compute[76870]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 20 14:43:59 user nova-compute[76870]:       <listen type='address' address='0.0.0.0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </graphics>
Oct 20 14:43:59 user nova-compute[76870]:     <audio id='1' type='none'/>
Oct 20 14:43:59 user nova-compute[76870]:     <video>
Oct 20 14:43:59 user nova-compute[76870]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='video0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </video>
Oct 20 14:43:59 user nova-compute[76870]:     <memballoon model='virtio'>
Oct 20 14:43:59 user nova-compute[76870]:       <stats period='10'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='balloon0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </memballoon>
Oct 20 14:43:59 user nova-compute[76870]:     <rng model='virtio'>
Oct 20 14:43:59 user nova-compute[76870]:       <backend model='random'>/dev/urandom</backend>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='rng0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </rng>
Oct 20 14:43:59 user nova-compute[76870]:   </devices>
Oct 20 14:43:59 user nova-compute[76870]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 14:43:59 user nova-compute[76870]:     <label>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</label>
Oct 20 14:43:59 user nova-compute[76870]:     <imagelabel>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</imagelabel>
Oct 20 14:43:59 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:59 user nova-compute[76870]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 14:43:59 user nova-compute[76870]:     <label>+64055:+108</label>
Oct 20 14:43:59 user nova-compute[76870]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 14:43:59 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:59 user nova-compute[76870]: </domain>
Oct 20 14:43:59 user nova-compute[76870]:  {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface> {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:1c:38:17"/><model type="virtio"/><mtu size="1442"/><target dev="tapa58d5a1c-7d"/></interface>not found in domain: <domain type='kvm' id='22'>
Oct 20 14:43:59 user nova-compute[76870]:   <name>instance-00000015</name>
Oct 20 14:43:59 user nova-compute[76870]:   <uuid>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</uuid>
Oct 20 14:43:59 user nova-compute[76870]:   <metadata>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:43:59 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:43:59</nova:creationTime>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:43:59 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:ports>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:43:59 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:43:59 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:ports>
Oct 20 14:43:59 user nova-compute[76870]: </nova:instance>
Oct 20 14:43:59 user nova-compute[76870]:   </metadata>
Oct 20 14:43:59 user nova-compute[76870]:   <memory unit='KiB'>524288</memory>
Oct 20 14:43:59 user nova-compute[76870]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 14:43:59 user nova-compute[76870]:   <vcpu placement='static'>1</vcpu>
Oct 20 14:43:59 user nova-compute[76870]:   <resource>
Oct 20 14:43:59 user nova-compute[76870]:     <partition>/machine</partition>
Oct 20 14:43:59 user nova-compute[76870]:   </resource>
Oct 20 14:43:59 user nova-compute[76870]:   <sysinfo type='smbios'>
Oct 20 14:43:59 user nova-compute[76870]:     <system>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='version'>0.0.0</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='serial'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='uuid'>7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</entry>
Oct 20 14:43:59 user nova-compute[76870]:       <entry name='family'>Virtual Machine</entry>
Oct 20 14:43:59 user nova-compute[76870]:     </system>
Oct 20 14:43:59 user nova-compute[76870]:   </sysinfo>
Oct 20 14:43:59 user nova-compute[76870]:   <os>
Oct 20 14:43:59 user nova-compute[76870]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 14:43:59 user nova-compute[76870]:     <boot dev='hd'/>
Oct 20 14:43:59 user nova-compute[76870]:     <smbios mode='sysinfo'/>
Oct 20 14:43:59 user nova-compute[76870]:   </os>
Oct 20 14:43:59 user nova-compute[76870]:   <features>
Oct 20 14:43:59 user nova-compute[76870]:     <acpi/>
Oct 20 14:43:59 user nova-compute[76870]:     <apic/>
Oct 20 14:43:59 user nova-compute[76870]:     <vmcoreinfo state='on'/>
Oct 20 14:43:59 user nova-compute[76870]:   </features>
Oct 20 14:43:59 user nova-compute[76870]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 14:43:59 user nova-compute[76870]:     <model fallback='forbid'>Nehalem</model>
Oct 20 14:43:59 user nova-compute[76870]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='vme'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='x2apic'/>
Oct 20 14:43:59 user nova-compute[76870]:     <feature policy='require' name='hypervisor'/>
Oct 20 14:43:59 user nova-compute[76870]:   </cpu>
Oct 20 14:43:59 user nova-compute[76870]:   <clock offset='utc'>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 14:43:59 user nova-compute[76870]:     <timer name='hpet' present='no'/>
Oct 20 14:43:59 user nova-compute[76870]:   </clock>
Oct 20 14:43:59 user nova-compute[76870]:   <on_poweroff>destroy</on_poweroff>
Oct 20 14:43:59 user nova-compute[76870]:   <on_reboot>restart</on_reboot>
Oct 20 14:43:59 user nova-compute[76870]:   <on_crash>destroy</on_crash>
Oct 20 14:43:59 user nova-compute[76870]:   <devices>
Oct 20 14:43:59 user nova-compute[76870]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 14:43:59 user nova-compute[76870]:     <disk type='file' device='disk'>
Oct 20 14:43:59 user nova-compute[76870]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 14:43:59 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk' index='2'/>
Oct 20 14:43:59 user nova-compute[76870]:       <backingStore type='file' index='3'>
Oct 20 14:43:59 user nova-compute[76870]:         <format type='raw'/>
Oct 20 14:43:59 user nova-compute[76870]:         <source file='/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3'/>
Oct 20 14:43:59 user nova-compute[76870]:         <backingStore/>
Oct 20 14:43:59 user nova-compute[76870]:       </backingStore>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='vda' bus='virtio'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='virtio-disk0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </disk>
Oct 20 14:43:59 user nova-compute[76870]:     <disk type='file' device='cdrom'>
Oct 20 14:43:59 user nova-compute[76870]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 14:43:59 user nova-compute[76870]:       <source file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/disk.config' index='1'/>
Oct 20 14:43:59 user nova-compute[76870]:       <backingStore/>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='hda' bus='ide'/>
Oct 20 14:43:59 user nova-compute[76870]:       <readonly/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='ide0-0-0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </disk>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='usb' index='0' model='none'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='usb'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='pci.0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <controller type='ide' index='0'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='ide'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 14:43:59 user nova-compute[76870]:     </controller>
Oct 20 14:43:59 user nova-compute[76870]:     <interface type='ethernet'>
Oct 20 14:43:59 user nova-compute[76870]:       <mac address='fa:16:3e:23:7d:66'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target dev='tap623b384d-04'/>
Oct 20 14:43:59 user nova-compute[76870]:       <model type='virtio'/>
Oct 20 14:43:59 user nova-compute[76870]:       <mtu size='1442'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='net0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </interface>
Oct 20 14:43:59 user nova-compute[76870]:     <serial type='pty'>
Oct 20 14:43:59 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:59 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target type='isa-serial' port='0'>
Oct 20 14:43:59 user nova-compute[76870]:         <model name='isa-serial'/>
Oct 20 14:43:59 user nova-compute[76870]:       </target>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </serial>
Oct 20 14:43:59 user nova-compute[76870]:     <console type='pty' tty='/dev/pts/8'>
Oct 20 14:43:59 user nova-compute[76870]:       <source path='/dev/pts/8'/>
Oct 20 14:43:59 user nova-compute[76870]:       <log file='/opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7/console.log' append='off'/>
Oct 20 14:43:59 user nova-compute[76870]:       <target type='serial' port='0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='serial0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </console>
Oct 20 14:43:59 user nova-compute[76870]:     <input type='mouse' bus='ps2'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='input0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </input>
Oct 20 14:43:59 user nova-compute[76870]:     <input type='keyboard' bus='ps2'>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='input1'/>
Oct 20 14:43:59 user nova-compute[76870]:     </input>
Oct 20 14:43:59 user nova-compute[76870]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 20 14:43:59 user nova-compute[76870]:       <listen type='address' address='0.0.0.0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </graphics>
Oct 20 14:43:59 user nova-compute[76870]:     <audio id='1' type='none'/>
Oct 20 14:43:59 user nova-compute[76870]:     <video>
Oct 20 14:43:59 user nova-compute[76870]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='video0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </video>
Oct 20 14:43:59 user nova-compute[76870]:     <memballoon model='virtio'>
Oct 20 14:43:59 user nova-compute[76870]:       <stats period='10'/>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='balloon0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </memballoon>
Oct 20 14:43:59 user nova-compute[76870]:     <rng model='virtio'>
Oct 20 14:43:59 user nova-compute[76870]:       <backend model='random'>/dev/urandom</backend>
Oct 20 14:43:59 user nova-compute[76870]:       <alias name='rng0'/>
Oct 20 14:43:59 user nova-compute[76870]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 14:43:59 user nova-compute[76870]:     </rng>
Oct 20 14:43:59 user nova-compute[76870]:   </devices>
Oct 20 14:43:59 user nova-compute[76870]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 14:43:59 user nova-compute[76870]:     <label>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</label>
Oct 20 14:43:59 user nova-compute[76870]:     <imagelabel>libvirt-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7</imagelabel>
Oct 20 14:43:59 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:59 user nova-compute[76870]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 14:43:59 user nova-compute[76870]:     <label>+64055:+108</label>
Oct 20 14:43:59 user nova-compute[76870]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 14:43:59 user nova-compute[76870]:   </seclabel>
Oct 20 14:43:59 user nova-compute[76870]: </domain>
Oct 20 14:43:59 user nova-compute[76870]:  {{(pid=76870) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 14:43:59 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Detaching interface fa:16:3e:1c:38:17 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa58d5a1c-7d' not found.
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Converting VIF {"id": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "address": "fa:16:3e:1c:38:17", "network": {"id": "08d026fb-e7f1-438d-875c-792c285508e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-980787674", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa58d5a1c-7d", "ovs_interfaceid": "a58d5a1c-7d41-4909-aa28-b25cc621f1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG os_vif [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa58d5a1c-7d, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:43:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:43:59 user nova-compute[76870]: INFO os_vif [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:38:17,bridge_name='br-int',has_traffic_filtering=True,id=a58d5a1c-7d41-4909-aa28-b25cc621f1b1,network=Network(08d026fb-e7f1-438d-875c-792c285508e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa58d5a1c-7d')
Oct 20 14:43:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [req-4a373315-20c5-44e6-b014-d466645973b9 req-61625a08-d153-465c-bd5b-5b0761b6b4de service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:43:59 user nova-compute[76870]:   <nova:package version="0.0.0"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:name>tempest-device-tagging-server-1456257204</nova:name>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:creationTime>2023-10-20 14:43:59</nova:creationTime>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:flavor name="m1.tiny">
Oct 20 14:43:59 user nova-compute[76870]:     <nova:memory>512</nova:memory>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:disk>1</nova:disk>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:swap>0</nova:swap>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:vcpus>1</nova:vcpus>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:flavor>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:user uuid="26a1441e1a3140d29da68799c0207d47">tempest-TaggedAttachmentsTest-245067760-project-member</nova:user>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:project uuid="10d26bb4eb934036b1ea3cc48b16ed42">tempest-TaggedAttachmentsTest-245067760</nova:project>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:owner>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:43:59 user nova-compute[76870]:   <nova:ports>
Oct 20 14:43:59 user nova-compute[76870]:     <nova:port uuid="623b384d-045a-4a86-9b9b-d4432a52555f">
Oct 20 14:43:59 user nova-compute[76870]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 14:43:59 user nova-compute[76870]:     </nova:port>
Oct 20 14:43:59 user nova-compute[76870]:   </nova:ports>
Oct 20 14:43:59 user nova-compute[76870]: </nova:instance>
Oct 20 14:43:59 user nova-compute[76870]:  {{(pid=76870) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 14:44:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [{"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Releasing lock "refresh_cache-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:44:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-53310754-b1d3-4770-9a9a-5c9a0b97dfda tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "interface-7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-a58d5a1c-7d41-4909-aa28-b25cc621f1b1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.421s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:44:09 user nova-compute[76870]: INFO nova.compute.claims [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Claim successful on node user
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.network.neutron [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:44:09 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:44:09 user nova-compute[76870]: DEBUG nova.policy [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9efb8ffb0f7f47f1ab587820e0f72c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3077015e86bc441e8a6622b6af839537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:44:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Creating image(s)
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "/opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk 1073741824" returned: 0 in 0.050s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.network.neutron [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Successfully created port: 8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Cannot resize image /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Ensure instance console log exists: /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Successfully updated port: 8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquired lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-changed-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Refreshing instance network info cache due to event network-changed-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] Acquiring lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updating instance_info_cache with network_info: [{"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Releasing lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Instance network_info: |[{"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] Acquired lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Refreshing network info cache for port 8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Start _get_guest_xml network_info=[{"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:44:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:44:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1136714047',display_name='tempest-AttachVolumeNegativeTest-server-1136714047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1136714047',id=24,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe2cEER4qZoRMNiFyskGT5ooLhTBdROMnH0wk8T5e+qXQrxZBsHkrb28L/9t9FHfkEGLBO7/gOfPQjCHTi73xYTwznK89sqKaD7Hvh9YuJN0OnlaE41iTeGt4FLPviWhg==',key_name='tempest-keypair-1615230115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-04twbcx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=7399dd8d-e135-45f3-b414-55111ec046aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.objects.instance [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'pci_devices' on Instance uuid 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:44:11 user nova-compute[76870]:   <uuid>7399dd8d-e135-45f3-b414-55111ec046aa</uuid>
Oct 20 14:44:11 user nova-compute[76870]:   <name>instance-00000018</name>
Oct 20 14:44:11 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:44:11 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:44:11 user nova-compute[76870]:   <metadata>
Oct 20 14:44:11 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:44:11 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:44:11 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1136714047</nova:name>
Oct 20 14:44:11 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:44:11</nova:creationTime>
Oct 20 14:44:11 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:44:11 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:44:11 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:44:11 user nova-compute[76870]:       <nova:owner>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:user uuid="9efb8ffb0f7f47f1ab587820e0f72c91">tempest-AttachVolumeNegativeTest-742706560-project-member</nova:user>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:project uuid="3077015e86bc441e8a6622b6af839537">tempest-AttachVolumeNegativeTest-742706560</nova:project>
Oct 20 14:44:11 user nova-compute[76870]:       </nova:owner>
Oct 20 14:44:11 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:44:11 user nova-compute[76870]:       <nova:ports>
Oct 20 14:44:11 user nova-compute[76870]:         <nova:port uuid="8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591">
Oct 20 14:44:11 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:44:11 user nova-compute[76870]:         </nova:port>
Oct 20 14:44:11 user nova-compute[76870]:       </nova:ports>
Oct 20 14:44:11 user nova-compute[76870]:     </nova:instance>
Oct 20 14:44:11 user nova-compute[76870]:   </metadata>
Oct 20 14:44:11 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:44:11 user nova-compute[76870]:     <system>
Oct 20 14:44:11 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:44:11 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:44:11 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:44:11 user nova-compute[76870]:       <entry name="serial">7399dd8d-e135-45f3-b414-55111ec046aa</entry>
Oct 20 14:44:11 user nova-compute[76870]:       <entry name="uuid">7399dd8d-e135-45f3-b414-55111ec046aa</entry>
Oct 20 14:44:11 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:44:11 user nova-compute[76870]:     </system>
Oct 20 14:44:11 user nova-compute[76870]:   </sysinfo>
Oct 20 14:44:11 user nova-compute[76870]:   <os>
Oct 20 14:44:11 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:44:11 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:44:11 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:44:11 user nova-compute[76870]:   </os>
Oct 20 14:44:11 user nova-compute[76870]:   <features>
Oct 20 14:44:11 user nova-compute[76870]:     <acpi/>
Oct 20 14:44:11 user nova-compute[76870]:     <apic/>
Oct 20 14:44:11 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:44:11 user nova-compute[76870]:   </features>
Oct 20 14:44:11 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:44:11 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:44:11 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:44:11 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:44:11 user nova-compute[76870]:   </clock>
Oct 20 14:44:11 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:44:11 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:44:11 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:44:11 user nova-compute[76870]:   </cpu>
Oct 20 14:44:11 user nova-compute[76870]:   <devices>
Oct 20 14:44:11 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:44:11 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:44:11 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk"/>
Oct 20 14:44:11 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:44:11 user nova-compute[76870]:     </disk>
Oct 20 14:44:11 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:44:11 user nova-compute[76870]:       <mac address="fa:16:3e:c0:94:54"/>
Oct 20 14:44:11 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:44:11 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:44:11 user nova-compute[76870]:       <target dev="tap8bc9ee47-3e"/>
Oct 20 14:44:11 user nova-compute[76870]:     </interface>
Oct 20 14:44:11 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:44:11 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/console.log" append="off"/>
Oct 20 14:44:11 user nova-compute[76870]:     </serial>
Oct 20 14:44:11 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:44:11 user nova-compute[76870]:     <video>
Oct 20 14:44:11 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:44:11 user nova-compute[76870]:     </video>
Oct 20 14:44:11 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:44:11 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:44:11 user nova-compute[76870]:     </rng>
Oct 20 14:44:11 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:44:11 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:44:11 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:44:11 user nova-compute[76870]:     </memballoon>
Oct 20 14:44:11 user nova-compute[76870]:   </devices>
Oct 20 14:44:11 user nova-compute[76870]: </domain>
Oct 20 14:44:11 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1136714047',display_name='tempest-AttachVolumeNegativeTest-server-1136714047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1136714047',id=24,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe2cEER4qZoRMNiFyskGT5ooLhTBdROMnH0wk8T5e+qXQrxZBsHkrb28L/9t9FHfkEGLBO7/gOfPQjCHTi73xYTwznK89sqKaD7Hvh9YuJN0OnlaE41iTeGt4FLPviWhg==',key_name='tempest-keypair-1615230115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-04twbcx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=7399dd8d-e135-45f3-b414-55111ec046aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG os_vif [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89fffda8-ed3e-5450-ac21-2330e0cf4965', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bc9ee47-3e, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bc9ee47-3e, col_values=(('qos', UUID('6b03c928-74f5-4f47-8aef-4e07326fbe99')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bc9ee47-3e, col_values=(('external_ids', {'iface-id': '8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:94:54', 'vm-uuid': '7399dd8d-e135-45f3-b414-55111ec046aa'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:11 user nova-compute[76870]: INFO os_vif [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e')
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:c0:94:54, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updated VIF entry in instance network info cache for port 8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:44:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updating instance_info_cache with network_info: [{"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ac147171-a68f-44f4-b544-fcf53179fac1 req-57cffe50-7c8a-4672-a8c6-cb40e96f2eaf service nova] Releasing lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-3ff96e7b-b893-49d9-aff3-21b317db7899 req-8761ab19-1283-4e7a-9536-fb5046fd1ab6 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3ff96e7b-b893-49d9-aff3-21b317db7899 req-8761ab19-1283-4e7a-9536-fb5046fd1ab6 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3ff96e7b-b893-49d9-aff3-21b317db7899 req-8761ab19-1283-4e7a-9536-fb5046fd1ab6 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3ff96e7b-b893-49d9-aff3-21b317db7899 req-8761ab19-1283-4e7a-9536-fb5046fd1ab6 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-3ff96e7b-b893-49d9-aff3-21b317db7899 req-8761ab19-1283-4e7a-9536-fb5046fd1ab6 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:13 user nova-compute[76870]: WARNING nova.compute.manager [req-3ff96e7b-b893-49d9-aff3-21b317db7899 req-8761ab19-1283-4e7a-9536-fb5046fd1ab6 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received unexpected event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with vm_state building and task_state spawning.
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:44:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Instance spawned successfully.
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:44:15 user nova-compute[76870]: INFO nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:44:15 user nova-compute[76870]: INFO nova.compute.manager [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Took 6.00 seconds to build instance.
Oct 20 14:44:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-37488d9f-92f4-43d8-88b7-2e20a0cb4942 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.101s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-8388c81b-b54a-49b4-82fd-c0218ece61f3 req-5d83d14b-0553-4434-a030-f5aff795d681 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8388c81b-b54a-49b4-82fd-c0218ece61f3 req-5d83d14b-0553-4434-a030-f5aff795d681 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8388c81b-b54a-49b4-82fd-c0218ece61f3 req-5d83d14b-0553-4434-a030-f5aff795d681 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8388c81b-b54a-49b4-82fd-c0218ece61f3 req-5d83d14b-0553-4434-a030-f5aff795d681 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-8388c81b-b54a-49b4-82fd-c0218ece61f3 req-5d83d14b-0553-4434-a030-f5aff795d681 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:15 user nova-compute[76870]: WARNING nova.compute.manager [req-8388c81b-b54a-49b4-82fd-c0218ece61f3 req-5d83d14b-0553-4434-a030-f5aff795d681 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received unexpected event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with vm_state active and task_state None.
Oct 20 14:44:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:16 user nova-compute[76870]: INFO nova.compute.manager [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Terminating instance
Oct 20 14:44:16 user nova-compute[76870]: DEBUG nova.compute.manager [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-68de02d3-0ef0-4856-a9e4-3fb566143f44 req-da350088-320d-4d8a-841d-f9db99108450 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68de02d3-0ef0-4856-a9e4-3fb566143f44 req-da350088-320d-4d8a-841d-f9db99108450 service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68de02d3-0ef0-4856-a9e4-3fb566143f44 req-da350088-320d-4d8a-841d-f9db99108450 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-68de02d3-0ef0-4856-a9e4-3fb566143f44 req-da350088-320d-4d8a-841d-f9db99108450 service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-68de02d3-0ef0-4856-a9e4-3fb566143f44 req-da350088-320d-4d8a-841d-f9db99108450 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-68de02d3-0ef0-4856-a9e4-3fb566143f44 req-da350088-320d-4d8a-841d-f9db99108450 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-unplugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:44:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Instance destroyed successfully.
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.objects.instance [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lazy-loading 'resources' on Instance uuid e51d3dd1-98b7-49ad-bacf-f76ae5961963 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1236982515',display_name='tempest-ServerStableDeviceRescueTest-server-1236982515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1236982515',id=14,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa0xAD6rR4ur738WniBVFOJTLLjE7g5xf7KHCpl9EPmGFrx5Hk1ZeGbLCrjJRKWZcWm9kpzqlnwXpFYGY4tVS0tLDzx2cUVYco6IszVAWtoNbTsCEGzgLT/dkGG3fXcPw==',key_name='tempest-keypair-114909760',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:41:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecc3c7784fb14a7ba60637eb343e4536',ramdisk_id='',reservation_id='r-3ck0n3p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1598823131',owner_user_name='tempest-ServerStableDeviceRescueTest-1598823131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3094cfbcdd5148aba1d1ce26587df977',uuid=e51d3dd1-98b7-49ad-bacf-f76ae5961963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converting VIF {"id": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "address": "fa:16:3e:66:c7:68", "network": {"id": "9bf3ffa4-7774-4dab-9296-60d476221cd1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997229022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecc3c7784fb14a7ba60637eb343e4536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5df74b-2f", "ovs_interfaceid": "2b5df74b-2f39-43d5-8bfa-c56de7663d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG os_vif [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b5df74b-2f, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7826192-bcb1-4e7b-8bcd-e95142d949e0) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: INFO os_vif [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:c7:68,bridge_name='br-int',has_traffic_filtering=True,id=2b5df74b-2f39-43d5-8bfa-c56de7663d71,network=Network(9bf3ffa4-7774-4dab-9296-60d476221cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5df74b-2f')
Oct 20 14:44:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Deleting instance files /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963_del
Oct 20 14:44:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Deletion of /opt/stack/data/nova/instances/e51d3dd1-98b7-49ad-bacf-f76ae5961963_del complete
Oct 20 14:44:17 user nova-compute[76870]: INFO nova.compute.manager [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:17 user nova-compute[76870]: INFO nova.compute.manager [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Terminating instance
Oct 20 14:44:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-0e878929-8f6c-4600-8ad4-0f6ef33c60ba req-afcb0488-98bd-43d7-82da-8a229911b4ac service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-unplugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0e878929-8f6c-4600-8ad4-0f6ef33c60ba req-afcb0488-98bd-43d7-82da-8a229911b4ac service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0e878929-8f6c-4600-8ad4-0f6ef33c60ba req-afcb0488-98bd-43d7-82da-8a229911b4ac service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0e878929-8f6c-4600-8ad4-0f6ef33c60ba req-afcb0488-98bd-43d7-82da-8a229911b4ac service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-0e878929-8f6c-4600-8ad4-0f6ef33c60ba req-afcb0488-98bd-43d7-82da-8a229911b4ac service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-unplugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-0e878929-8f6c-4600-8ad4-0f6ef33c60ba req-afcb0488-98bd-43d7-82da-8a229911b4ac service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-unplugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'info_cache' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Instance destroyed successfully.
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.objects.instance [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'resources' on Instance uuid 844f56f6-be92-4c0b-88a9-55a82b330646 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1740794095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1740794095',id=17,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Vht16OCN4sPyGhaf3+hnoNK9immod4cIIJ6znYvCe10mAAb2RHE6Ol3iH8L1oRDb8RL/6sW6PkS7xWx8SYu0ITeMg4JYKTSo+f6rozBLPuvZFuZ+c/OkeliQuvQzK9A==',key_name='tempest-keypair-737388622',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-if0prmy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=844f56f6-be92-4c0b-88a9-55a82b330646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "address": "fa:16:3e:c1:da:15", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c77894-1f", "ovs_interfaceid": "01c77894-1f28-4395-81e2-ca97beaf0d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG os_vif [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01c77894-1f, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=991987ad-2559-4e42-9838-ac5cac8b3de7) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:18 user nova-compute[76870]: INFO os_vif [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:da:15,bridge_name='br-int',has_traffic_filtering=True,id=01c77894-1f28-4395-81e2-ca97beaf0d5c,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c77894-1f')
Oct 20 14:44:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Deleting instance files /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646_del
Oct 20 14:44:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Deletion of /opt/stack/data/nova/instances/844f56f6-be92-4c0b-88a9-55a82b330646_del complete
Oct 20 14:44:18 user nova-compute[76870]: INFO nova.compute.manager [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:18 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Took 1.20 seconds to deallocate network for instance.
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:44:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance destroyed successfully.
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'resources' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG os_vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9baeaf20-f1, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e35b6f8e-d8dc-4b67-93dd-35d6280de7c9) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:19 user nova-compute[76870]: INFO os_vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1')
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start _get_guest_xml network_info=[{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'numa_topology' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:44:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-3992d232-47a3-49ff-90d9-691c2914118b req-d536e87b-91ed-40c5-9164-906158e960bd service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3992d232-47a3-49ff-90d9-691c2914118b req-d536e87b-91ed-40c5-9164-906158e960bd service nova] Acquiring lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3992d232-47a3-49ff-90d9-691c2914118b req-d536e87b-91ed-40c5-9164-906158e960bd service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3992d232-47a3-49ff-90d9-691c2914118b req-d536e87b-91ed-40c5-9164-906158e960bd service nova] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-3992d232-47a3-49ff-90d9-691c2914118b req-d536e87b-91ed-40c5-9164-906158e960bd service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] No waiting events found dispatching network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:19 user nova-compute[76870]: WARNING nova.compute.manager [req-3992d232-47a3-49ff-90d9-691c2914118b req-d536e87b-91ed-40c5-9164-906158e960bd service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received unexpected event network-vif-plugged-2b5df74b-2f39-43d5-8bfa-c56de7663d71 for instance with vm_state deleted and task_state None.
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'vcpu_model' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'pci_devices' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:44:19 user nova-compute[76870]:   <uuid>231934b4-7eee-443f-bbf4-6253e3e9705c</uuid>
Oct 20 14:44:19 user nova-compute[76870]:   <name>instance-0000000c</name>
Oct 20 14:44:19 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:44:19 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:44:19 user nova-compute[76870]:   <metadata>
Oct 20 14:44:19 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:44:19 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:44:19 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeTestJSON-server-573954456</nova:name>
Oct 20 14:44:19 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:44:19</nova:creationTime>
Oct 20 14:44:19 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:44:19 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:44:19 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:44:19 user nova-compute[76870]:       <nova:owner>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:user uuid="859e78a4758a4cafa8e547e12126b1e4">tempest-AttachVolumeTestJSON-345124704-project-member</nova:user>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:project uuid="d99999331a734dc0b3cc9fcc517dfc9a">tempest-AttachVolumeTestJSON-345124704</nova:project>
Oct 20 14:44:19 user nova-compute[76870]:       </nova:owner>
Oct 20 14:44:19 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:44:19 user nova-compute[76870]:       <nova:ports>
Oct 20 14:44:19 user nova-compute[76870]:         <nova:port uuid="9baeaf20-f156-4777-a8cf-c85722913a76">
Oct 20 14:44:19 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:44:19 user nova-compute[76870]:         </nova:port>
Oct 20 14:44:19 user nova-compute[76870]:       </nova:ports>
Oct 20 14:44:19 user nova-compute[76870]:     </nova:instance>
Oct 20 14:44:19 user nova-compute[76870]:   </metadata>
Oct 20 14:44:19 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:44:19 user nova-compute[76870]:     <system>
Oct 20 14:44:19 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:44:19 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:44:19 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:44:19 user nova-compute[76870]:       <entry name="serial">231934b4-7eee-443f-bbf4-6253e3e9705c</entry>
Oct 20 14:44:19 user nova-compute[76870]:       <entry name="uuid">231934b4-7eee-443f-bbf4-6253e3e9705c</entry>
Oct 20 14:44:19 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:44:19 user nova-compute[76870]:     </system>
Oct 20 14:44:19 user nova-compute[76870]:   </sysinfo>
Oct 20 14:44:19 user nova-compute[76870]:   <os>
Oct 20 14:44:19 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:44:19 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:44:19 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:44:19 user nova-compute[76870]:   </os>
Oct 20 14:44:19 user nova-compute[76870]:   <features>
Oct 20 14:44:19 user nova-compute[76870]:     <acpi/>
Oct 20 14:44:19 user nova-compute[76870]:     <apic/>
Oct 20 14:44:19 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:44:19 user nova-compute[76870]:   </features>
Oct 20 14:44:19 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:44:19 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:44:19 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:44:19 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:44:19 user nova-compute[76870]:   </clock>
Oct 20 14:44:19 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:44:19 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:44:19 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:44:19 user nova-compute[76870]:   </cpu>
Oct 20 14:44:19 user nova-compute[76870]:   <devices>
Oct 20 14:44:19 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:44:19 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:44:19 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk"/>
Oct 20 14:44:19 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:44:19 user nova-compute[76870]:     </disk>
Oct 20 14:44:19 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:44:19 user nova-compute[76870]:       <mac address="fa:16:3e:1f:2b:34"/>
Oct 20 14:44:19 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:44:19 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:44:19 user nova-compute[76870]:       <target dev="tap9baeaf20-f1"/>
Oct 20 14:44:19 user nova-compute[76870]:     </interface>
Oct 20 14:44:19 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:44:19 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/console.log" append="off"/>
Oct 20 14:44:19 user nova-compute[76870]:     </serial>
Oct 20 14:44:19 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:44:19 user nova-compute[76870]:     <video>
Oct 20 14:44:19 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:44:19 user nova-compute[76870]:     </video>
Oct 20 14:44:19 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:44:19 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:44:19 user nova-compute[76870]:     </rng>
Oct 20 14:44:19 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:44:19 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:44:19 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:44:19 user nova-compute[76870]:     </memballoon>
Oct 20 14:44:19 user nova-compute[76870]:   </devices>
Oct 20 14:44:19 user nova-compute[76870]: </domain>
Oct 20 14:44:19 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:19 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Deleted allocations for instance e51d3dd1-98b7-49ad-bacf-f76ae5961963
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-994a1498-0864-4696-8bd5-70b0ceef79ee tempest-ServerStableDeviceRescueTest-1598823131 tempest-ServerStableDeviceRescueTest-1598823131-project-member] Lock "e51d3dd1-98b7-49ad-bacf-f76ae5961963" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.793s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'trusted_certs' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-c82ea10e-f376-48ea-b4be-4a138c57d153 req-9a582ab5-6fa3-45ef-8dab-59f8b9875af4 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-deleted-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:19 user nova-compute[76870]: INFO nova.compute.manager [req-c82ea10e-f376-48ea-b4be-4a138c57d153 req-9a582ab5-6fa3-45ef-8dab-59f8b9875af4 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Neutron deleted interface 01c77894-1f28-4395-81e2-ca97beaf0d5c; detaching it from the instance and deleting it from the info cache
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.neutron [req-c82ea10e-f376-48ea-b4be-4a138c57d153 req-9a582ab5-6fa3-45ef-8dab-59f8b9875af4 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:19 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Took 1.13 seconds to deallocate network for instance.
Oct 20 14:44:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-c82ea10e-f376-48ea-b4be-4a138c57d153 req-9a582ab5-6fa3-45ef-8dab-59f8b9875af4 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Detach interface failed, port_id=01c77894-1f28-4395-81e2-ca97beaf0d5c, reason: Instance 844f56f6-be92-4c0b-88a9-55a82b330646 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Cannot resize image /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'migration_context' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.objects.base [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Object Instance<231934b4-7eee-443f-bbf4-6253e3e9705c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG os_vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c31edbd-9249-5ed1-b6d1-4bc267a69642', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9baeaf20-f1, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9baeaf20-f1, col_values=(('qos', UUID('8964c3fe-c994-46af-bf29-9e6d06d68f62')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9baeaf20-f1, col_values=(('external_ids', {'iface-id': '9baeaf20-f156-4777-a8cf-c85722913a76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2b:34', 'vm-uuid': '231934b4-7eee-443f-bbf4-6253e3e9705c'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:20 user nova-compute[76870]: INFO os_vif [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1')
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] Acquiring lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] Lock "844f56f6-be92-4c0b-88a9-55a82b330646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] No waiting events found dispatching network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:20 user nova-compute[76870]: WARNING nova.compute.manager [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] [instance: 844f56f6-be92-4c0b-88a9-55a82b330646] Received unexpected event network-vif-plugged-01c77894-1f28-4395-81e2-ca97beaf0d5c for instance with vm_state deleted and task_state None.
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-8c3a4883-84b1-4fd8-8e11-9fe35f7b9654 req-55017e3a-c08d-42de-9061-5a5ae3d522b0 service nova] [instance: e51d3dd1-98b7-49ad-bacf-f76ae5961963] Received event network-vif-deleted-2b5df74b-2f39-43d5-8bfa-c56de7663d71 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:20 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Deleted allocations for instance 844f56f6-be92-4c0b-88a9-55a82b330646
Oct 20 14:44:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-546c6f50-4d91-4194-b3e9-7571403d7af5 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "844f56f6-be92-4c0b-88a9-55a82b330646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.676s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-19be365a-6bf8-44ef-b3fe-d15817df7e69 req-168a91a4-bc1b-43e3-bc3e-806e8dcc102a service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19be365a-6bf8-44ef-b3fe-d15817df7e69 req-168a91a4-bc1b-43e3-bc3e-806e8dcc102a service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19be365a-6bf8-44ef-b3fe-d15817df7e69 req-168a91a4-bc1b-43e3-bc3e-806e8dcc102a service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19be365a-6bf8-44ef-b3fe-d15817df7e69 req-168a91a4-bc1b-43e3-bc3e-806e8dcc102a service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-19be365a-6bf8-44ef-b3fe-d15817df7e69 req-168a91a4-bc1b-43e3-bc3e-806e8dcc102a service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:21 user nova-compute[76870]: WARNING nova.compute.manager [req-19be365a-6bf8-44ef-b3fe-d15817df7e69 req-168a91a4-bc1b-43e3-bc3e-806e8dcc102a service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state stopped and task_state powering-on.
Oct 20 14:44:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a22b36e-55cc-4787-a7ce-367342db8dc3 req-862e5930-f7b5-4d0e-9d1c-7a950f7a7abf service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a22b36e-55cc-4787-a7ce-367342db8dc3 req-862e5930-f7b5-4d0e-9d1c-7a950f7a7abf service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a22b36e-55cc-4787-a7ce-367342db8dc3 req-862e5930-f7b5-4d0e-9d1c-7a950f7a7abf service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a22b36e-55cc-4787-a7ce-367342db8dc3 req-862e5930-f7b5-4d0e-9d1c-7a950f7a7abf service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a22b36e-55cc-4787-a7ce-367342db8dc3 req-862e5930-f7b5-4d0e-9d1c-7a950f7a7abf service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:23 user nova-compute[76870]: WARNING nova.compute.manager [req-8a22b36e-55cc-4787-a7ce-367342db8dc3 req-862e5930-f7b5-4d0e-9d1c-7a950f7a7abf service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state stopped and task_state powering-on.
Oct 20 14:44:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:44:23 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance rebooted successfully.
Oct 20 14:44:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4e101878-7a1c-4c0d-b591-5be744bc8034 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:44:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:29 user nova-compute[76870]: INFO nova.compute.manager [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Terminating instance
Oct 20 14:44:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-17e3962c-ad3a-4361-a02d-dd207363fc04 req-7321d517-bccb-40ed-b45f-7323ff6050bd service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-unplugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-17e3962c-ad3a-4361-a02d-dd207363fc04 req-7321d517-bccb-40ed-b45f-7323ff6050bd service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-17e3962c-ad3a-4361-a02d-dd207363fc04 req-7321d517-bccb-40ed-b45f-7323ff6050bd service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-17e3962c-ad3a-4361-a02d-dd207363fc04 req-7321d517-bccb-40ed-b45f-7323ff6050bd service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-17e3962c-ad3a-4361-a02d-dd207363fc04 req-7321d517-bccb-40ed-b45f-7323ff6050bd service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-unplugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-17e3962c-ad3a-4361-a02d-dd207363fc04 req-7321d517-bccb-40ed-b45f-7323ff6050bd service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-unplugged-623b384d-045a-4a86-9b9b-d4432a52555f for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:30 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Instance destroyed successfully.
Oct 20 14:44:30 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lazy-loading 'resources' on Instance uuid 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T14:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1456257204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1456257204',id=21,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFdOT+D9J39Eb9ev6lvwhVZ464sy1Elm2//5oqm0f84lZi/1lfUkTX/hAyQDLeFbeaToeffHp2pIgi6Ysvv61EQc+II/ARm+4NiW2ynTqetEU0qicUQn+tLJ642zuA14Q==',key_name='tempest-keypair-1288619489',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10d26bb4eb934036b1ea3cc48b16ed42',ramdisk_id='',reservation_id='r-t01si0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-245067760',owner_user_name='tempest-TaggedAttachmentsTest-245067760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26a1441e1a3140d29da68799c0207d47',uuid=7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converting VIF {"id": "623b384d-045a-4a86-9b9b-d4432a52555f", "address": "fa:16:3e:23:7d:66", "network": {"id": "932f72f4-ae13-48cd-8f8b-8bfd093b7761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1559685943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10d26bb4eb934036b1ea3cc48b16ed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b384d-04", "ovs_interfaceid": "623b384d-045a-4a86-9b9b-d4432a52555f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG os_vif [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap623b384d-04, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d847815b-98ba-48ba-abcf-72b86c609fa0) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:30 user nova-compute[76870]: INFO os_vif [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:7d:66,bridge_name='br-int',has_traffic_filtering=True,id=623b384d-045a-4a86-9b9b-d4432a52555f,network=Network(932f72f4-ae13-48cd-8f8b-8bfd093b7761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b384d-04')
Oct 20 14:44:30 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Deleting instance files /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7_del
Oct 20 14:44:30 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Deletion of /opt/stack/data/nova/instances/7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7_del complete
Oct 20 14:44:30 user nova-compute[76870]: INFO nova.compute.manager [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 14:44:30 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:44:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:31 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Took 1.31 seconds to deallocate network for instance.
Oct 20 14:44:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-d4412f85-0183-4ec1-8a95-90cf50093b01 req-0002327f-3e33-4258-8310-ee92edaaafbf service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-deleted-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-2414c3bd-11cb-4d99-88d1-6e4610f24834 req-ede2f77b-92fb-4722-bea0-20d8c31da252 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received event network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2414c3bd-11cb-4d99-88d1-6e4610f24834 req-ede2f77b-92fb-4722-bea0-20d8c31da252 service nova] Acquiring lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2414c3bd-11cb-4d99-88d1-6e4610f24834 req-ede2f77b-92fb-4722-bea0-20d8c31da252 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2414c3bd-11cb-4d99-88d1-6e4610f24834 req-ede2f77b-92fb-4722-bea0-20d8c31da252 service nova] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-2414c3bd-11cb-4d99-88d1-6e4610f24834 req-ede2f77b-92fb-4722-bea0-20d8c31da252 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] No waiting events found dispatching network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:31 user nova-compute[76870]: WARNING nova.compute.manager [req-2414c3bd-11cb-4d99-88d1-6e4610f24834 req-ede2f77b-92fb-4722-bea0-20d8c31da252 service nova] [instance: 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7] Received unexpected event network-vif-plugged-623b384d-045a-4a86-9b9b-d4432a52555f for instance with vm_state deleted and task_state None.
Oct 20 14:44:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:44:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:31 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Deleted allocations for instance 7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7
Oct 20 14:44:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed3d299d-a3dd-4122-bc2e-32e76d4f50f8 tempest-TaggedAttachmentsTest-245067760 tempest-TaggedAttachmentsTest-245067760-project-member] Lock "7d4f01d2-d33d-4a5f-b6d0-8ce9def040f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.586s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "682be055-2825-4360-b0a0-eeecce00e7e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:33 user nova-compute[76870]: INFO nova.compute.manager [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Terminating instance
Oct 20 14:44:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc6f91fc-0e22-40ba-9a0d-4db5a77ea944 req-b1d73eba-f0f2-4eda-89d4-85613094155c service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-vif-unplugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc6f91fc-0e22-40ba-9a0d-4db5a77ea944 req-b1d73eba-f0f2-4eda-89d4-85613094155c service nova] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc6f91fc-0e22-40ba-9a0d-4db5a77ea944 req-b1d73eba-f0f2-4eda-89d4-85613094155c service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc6f91fc-0e22-40ba-9a0d-4db5a77ea944 req-b1d73eba-f0f2-4eda-89d4-85613094155c service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc6f91fc-0e22-40ba-9a0d-4db5a77ea944 req-b1d73eba-f0f2-4eda-89d4-85613094155c service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] No waiting events found dispatching network-vif-unplugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc6f91fc-0e22-40ba-9a0d-4db5a77ea944 req-b1d73eba-f0f2-4eda-89d4-85613094155c service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-vif-unplugged-44f026d1-28a4-4ce9-87f4-99616eb75183 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Instance destroyed successfully.
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.objects.instance [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lazy-loading 'resources' on Instance uuid 682be055-2825-4360-b0a0-eeecce00e7e8 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-56257863',display_name='tempest-VolumesActionsTest-instance-56257863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-56257863',id=23,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:42:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='705d22169e9d4c33beaba01971d0e10d',ramdisk_id='',reservation_id='r-cas9hef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1366356536',owner_user_name='tempest-VolumesActionsTest-1366356536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:42:50Z,user_data=None,user_id='41ffa7bfd51042efb29a472a9aabfbf1',uuid=682be055-2825-4360-b0a0-eeecce00e7e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converting VIF {"id": "44f026d1-28a4-4ce9-87f4-99616eb75183", "address": "fa:16:3e:ad:f9:3a", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f026d1-28", "ovs_interfaceid": "44f026d1-28a4-4ce9-87f4-99616eb75183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG os_vif [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44f026d1-28, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0938be7f-0635-4f58-8308-bc35d2121a95) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:34 user nova-compute[76870]: INFO os_vif [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f9:3a,bridge_name='br-int',has_traffic_filtering=True,id=44f026d1-28a4-4ce9-87f4-99616eb75183,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f026d1-28')
Oct 20 14:44:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Deleting instance files /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8_del
Oct 20 14:44:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Deletion of /opt/stack/data/nova/instances/682be055-2825-4360-b0a0-eeecce00e7e8_del complete
Oct 20 14:44:34 user nova-compute[76870]: INFO nova.compute.manager [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 14:44:34 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:44:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:35 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Took 0.55 seconds to deallocate network for instance.
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:35 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Deleted allocations for instance 682be055-2825-4360-b0a0-eeecce00e7e8
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-44795d35-8d7c-4545-902d-1a9dbd586f72 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "682be055-2825-4360-b0a0-eeecce00e7e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] Acquiring lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] Lock "682be055-2825-4360-b0a0-eeecce00e7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] No waiting events found dispatching network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:44:36 user nova-compute[76870]: WARNING nova.compute.manager [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received unexpected event network-vif-plugged-44f026d1-28a4-4ce9-87f4-99616eb75183 for instance with vm_state deleted and task_state None.
Oct 20 14:44:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-ee6c3b64-900e-49d4-b940-7044a24fb029 req-6ba2eeb7-a3d6-4f0c-9bbb-874a1901da38 service nova] [instance: 682be055-2825-4360-b0a0-eeecce00e7e8] Received event network-vif-deleted-44f026d1-28a4-4ce9-87f4-99616eb75183 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:44:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:44:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:44:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8029MB free_disk=25.25304412841797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f46d70-69fc-4985-ae20-1676a0efd8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7399dd8d-e135-45f3-b414-55111ec046aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:44:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:44:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:44:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:44:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:44:40 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:44:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [{"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:44:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-231934b4-7eee-443f-bbf4-6253e3e9705c" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:44:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:44:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:44:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:44:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:45:11 user nova-compute[76870]: INFO nova.compute.claims [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Claim successful on node user
Oct 20 14:45:11 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.network.neutron [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:45:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.policy [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a358910175f646c39bb6d7e12ed5334e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3670195fbec411c891e3ea8820b01d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:45:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Creating image(s)
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk 1073741824" returned: 0 in 0.051s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Cannot resize image /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Ensure instance console log exists: /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:12 user nova-compute[76870]: DEBUG nova.network.neutron [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Successfully created port: 137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Successfully updated port: 137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing instance network info cache due to event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance network_info: |[{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Start _get_guest_xml network_info=[{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:45:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1814354559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1814354559',id=25,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTwq03L6/YGp9fIcRcBxmdb6Nkd/LyCwM55OTvK37ZjHDgm5CaHvrje1k5DI246VE7gcKlIFOq1pkOCeKOk1vCTHe/ifeVCz9kdUstA2TIsXkIPTX3Je6oaqaWEt1GNw==',key_name='tempest-keypair-454063210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-s75dwr07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=4e56958e-edf4-4912-ac47-1ce9da96145f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:45:14 user nova-compute[76870]:   <uuid>4e56958e-edf4-4912-ac47-1ce9da96145f</uuid>
Oct 20 14:45:14 user nova-compute[76870]:   <name>instance-00000019</name>
Oct 20 14:45:14 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:45:14 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:45:14 user nova-compute[76870]:   <metadata>
Oct 20 14:45:14 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:45:14 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:45:14 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1814354559</nova:name>
Oct 20 14:45:14 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:45:13</nova:creationTime>
Oct 20 14:45:14 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:45:14 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:45:14 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:45:14 user nova-compute[76870]:       <nova:owner>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:user uuid="a358910175f646c39bb6d7e12ed5334e">tempest-AttachVolumeShelveTestJSON-801976804-project-member</nova:user>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:project uuid="b3670195fbec411c891e3ea8820b01d1">tempest-AttachVolumeShelveTestJSON-801976804</nova:project>
Oct 20 14:45:14 user nova-compute[76870]:       </nova:owner>
Oct 20 14:45:14 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:45:14 user nova-compute[76870]:       <nova:ports>
Oct 20 14:45:14 user nova-compute[76870]:         <nova:port uuid="137fb91e-867b-4702-8cd1-dcfdf81a25a7">
Oct 20 14:45:14 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 14:45:14 user nova-compute[76870]:         </nova:port>
Oct 20 14:45:14 user nova-compute[76870]:       </nova:ports>
Oct 20 14:45:14 user nova-compute[76870]:     </nova:instance>
Oct 20 14:45:14 user nova-compute[76870]:   </metadata>
Oct 20 14:45:14 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:45:14 user nova-compute[76870]:     <system>
Oct 20 14:45:14 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:45:14 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:45:14 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:45:14 user nova-compute[76870]:       <entry name="serial">4e56958e-edf4-4912-ac47-1ce9da96145f</entry>
Oct 20 14:45:14 user nova-compute[76870]:       <entry name="uuid">4e56958e-edf4-4912-ac47-1ce9da96145f</entry>
Oct 20 14:45:14 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:45:14 user nova-compute[76870]:     </system>
Oct 20 14:45:14 user nova-compute[76870]:   </sysinfo>
Oct 20 14:45:14 user nova-compute[76870]:   <os>
Oct 20 14:45:14 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:45:14 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:45:14 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:45:14 user nova-compute[76870]:   </os>
Oct 20 14:45:14 user nova-compute[76870]:   <features>
Oct 20 14:45:14 user nova-compute[76870]:     <acpi/>
Oct 20 14:45:14 user nova-compute[76870]:     <apic/>
Oct 20 14:45:14 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:45:14 user nova-compute[76870]:   </features>
Oct 20 14:45:14 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:45:14 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:45:14 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:45:14 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:45:14 user nova-compute[76870]:   </clock>
Oct 20 14:45:14 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:45:14 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:45:14 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:45:14 user nova-compute[76870]:   </cpu>
Oct 20 14:45:14 user nova-compute[76870]:   <devices>
Oct 20 14:45:14 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:45:14 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:45:14 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk"/>
Oct 20 14:45:14 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:45:14 user nova-compute[76870]:     </disk>
Oct 20 14:45:14 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:45:14 user nova-compute[76870]:       <mac address="fa:16:3e:9a:52:77"/>
Oct 20 14:45:14 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:14 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:45:14 user nova-compute[76870]:       <target dev="tap137fb91e-86"/>
Oct 20 14:45:14 user nova-compute[76870]:     </interface>
Oct 20 14:45:14 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:45:14 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/console.log" append="off"/>
Oct 20 14:45:14 user nova-compute[76870]:     </serial>
Oct 20 14:45:14 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:45:14 user nova-compute[76870]:     <video>
Oct 20 14:45:14 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:14 user nova-compute[76870]:     </video>
Oct 20 14:45:14 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:45:14 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:45:14 user nova-compute[76870]:     </rng>
Oct 20 14:45:14 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:45:14 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:45:14 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:45:14 user nova-compute[76870]:     </memballoon>
Oct 20 14:45:14 user nova-compute[76870]:   </devices>
Oct 20 14:45:14 user nova-compute[76870]: </domain>
Oct 20 14:45:14 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1814354559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1814354559',id=25,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTwq03L6/YGp9fIcRcBxmdb6Nkd/LyCwM55OTvK37ZjHDgm5CaHvrje1k5DI246VE7gcKlIFOq1pkOCeKOk1vCTHe/ifeVCz9kdUstA2TIsXkIPTX3Je6oaqaWEt1GNw==',key_name='tempest-keypair-454063210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-s75dwr07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=4e56958e-edf4-4912-ac47-1ce9da96145f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG os_vif [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b81d6e-3b33-5222-9423-3b7f8ca94116', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap137fb91e-86, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap137fb91e-86, col_values=(('qos', UUID('8682d008-5755-4c18-b77c-d6f3ad3da7fc')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap137fb91e-86, col_values=(('external_ids', {'iface-id': '137fb91e-867b-4702-8cd1-dcfdf81a25a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:52:77', 'vm-uuid': '4e56958e-edf4-4912-ac47-1ce9da96145f'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:14 user nova-compute[76870]: INFO os_vif [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86')
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No VIF found with MAC fa:16:3e:9a:52:77, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updated VIF entry in instance network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8fce5156-b69f-45c1-b64d-db7195f2480b req-7ae4c623-4676-4aff-9f92-f64b5f744e3c service nova] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-84f41cb8-33e3-4fea-9e09-26a32f91b17a req-b14f123e-bb2d-4d33-9843-c05b593d881d service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-84f41cb8-33e3-4fea-9e09-26a32f91b17a req-b14f123e-bb2d-4d33-9843-c05b593d881d service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-84f41cb8-33e3-4fea-9e09-26a32f91b17a req-b14f123e-bb2d-4d33-9843-c05b593d881d service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-84f41cb8-33e3-4fea-9e09-26a32f91b17a req-b14f123e-bb2d-4d33-9843-c05b593d881d service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-84f41cb8-33e3-4fea-9e09-26a32f91b17a req-b14f123e-bb2d-4d33-9843-c05b593d881d service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:15 user nova-compute[76870]: WARNING nova.compute.manager [req-84f41cb8-33e3-4fea-9e09-26a32f91b17a req-b14f123e-bb2d-4d33-9843-c05b593d881d service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state building and task_state spawning.
Oct 20 14:45:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:45:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance spawned successfully.
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-414a2205-8821-41a9-b4c3-7e51b014740c req-c61c6e75-9d89-4b76-92aa-2d0b5c106b92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-414a2205-8821-41a9-b4c3-7e51b014740c req-c61c6e75-9d89-4b76-92aa-2d0b5c106b92 service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-414a2205-8821-41a9-b4c3-7e51b014740c req-c61c6e75-9d89-4b76-92aa-2d0b5c106b92 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-414a2205-8821-41a9-b4c3-7e51b014740c req-c61c6e75-9d89-4b76-92aa-2d0b5c106b92 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-414a2205-8821-41a9-b4c3-7e51b014740c req-c61c6e75-9d89-4b76-92aa-2d0b5c106b92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:17 user nova-compute[76870]: WARNING nova.compute.manager [req-414a2205-8821-41a9-b4c3-7e51b014740c req-c61c6e75-9d89-4b76-92aa-2d0b5c106b92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state building and task_state spawning.
Oct 20 14:45:17 user nova-compute[76870]: INFO nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Took 5.54 seconds to spawn the instance on the hypervisor.
Oct 20 14:45:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:45:17 user nova-compute[76870]: INFO nova.compute.manager [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Took 6.24 seconds to build instance.
Oct 20 14:45:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-82cb1ee6-a83d-4285-9090-0cffa5a2fc24 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.350s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:45:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:25 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:45:25 user nova-compute[76870]: INFO nova.compute.claims [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Claim successful on node user
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:45:26 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.policy [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41ffa7bfd51042efb29a472a9aabfbf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '705d22169e9d4c33beaba01971d0e10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:45:26 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Creating image(s)
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "/opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "/opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk 1073741824" returned: 0 in 0.061s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Successfully created port: 2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Cannot resize image /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Ensure instance console log exists: /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Successfully updated port: 2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "refresh_cache-7f7f0d77-948f-4c3c-8308-1d8c531c6bff" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquired lock "refresh_cache-7f7f0d77-948f-4c3c-8308-1d8c531c6bff" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-changed-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Refreshing instance network info cache due to event network-changed-2a22331f-1c5d-4533-a3ce-f9813a1fda55. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] Acquiring lock "refresh_cache-7f7f0d77-948f-4c3c-8308-1d8c531c6bff" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Updating instance_info_cache with network_info: [{"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Releasing lock "refresh_cache-7f7f0d77-948f-4c3c-8308-1d8c531c6bff" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Instance network_info: |[{"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] Acquired lock "refresh_cache-7f7f0d77-948f-4c3c-8308-1d8c531c6bff" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Refreshing network info cache for port 2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Start _get_guest_xml network_info=[{"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:45:28 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:28 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-904147619',display_name='tempest-VolumesActionsTest-instance-904147619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-904147619',id=26,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='705d22169e9d4c33beaba01971d0e10d',ramdisk_id='',reservation_id='r-3phlvnhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1366356536',owner_user_name='tempest-VolumesActionsTest-1366356536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:26Z,user_data=None,user_id='41ffa7bfd51042efb29a472a9aabfbf1',uuid=7f7f0d77-948f-4c3c-8308-1d8c531c6bff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converting VIF {"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f7f0d77-948f-4c3c-8308-1d8c531c6bff {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:45:28 user nova-compute[76870]:   <uuid>7f7f0d77-948f-4c3c-8308-1d8c531c6bff</uuid>
Oct 20 14:45:28 user nova-compute[76870]:   <name>instance-0000001a</name>
Oct 20 14:45:28 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:45:28 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:45:28 user nova-compute[76870]:   <metadata>
Oct 20 14:45:28 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:45:28 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:45:28 user nova-compute[76870]:       <nova:name>tempest-VolumesActionsTest-instance-904147619</nova:name>
Oct 20 14:45:28 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:45:28</nova:creationTime>
Oct 20 14:45:28 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:45:28 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:45:28 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:45:28 user nova-compute[76870]:       <nova:owner>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:user uuid="41ffa7bfd51042efb29a472a9aabfbf1">tempest-VolumesActionsTest-1366356536-project-member</nova:user>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:project uuid="705d22169e9d4c33beaba01971d0e10d">tempest-VolumesActionsTest-1366356536</nova:project>
Oct 20 14:45:28 user nova-compute[76870]:       </nova:owner>
Oct 20 14:45:28 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:45:28 user nova-compute[76870]:       <nova:ports>
Oct 20 14:45:28 user nova-compute[76870]:         <nova:port uuid="2a22331f-1c5d-4533-a3ce-f9813a1fda55">
Oct 20 14:45:28 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 14:45:28 user nova-compute[76870]:         </nova:port>
Oct 20 14:45:28 user nova-compute[76870]:       </nova:ports>
Oct 20 14:45:28 user nova-compute[76870]:     </nova:instance>
Oct 20 14:45:28 user nova-compute[76870]:   </metadata>
Oct 20 14:45:28 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:45:28 user nova-compute[76870]:     <system>
Oct 20 14:45:28 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:45:28 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:45:28 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:45:28 user nova-compute[76870]:       <entry name="serial">7f7f0d77-948f-4c3c-8308-1d8c531c6bff</entry>
Oct 20 14:45:28 user nova-compute[76870]:       <entry name="uuid">7f7f0d77-948f-4c3c-8308-1d8c531c6bff</entry>
Oct 20 14:45:28 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:45:28 user nova-compute[76870]:     </system>
Oct 20 14:45:28 user nova-compute[76870]:   </sysinfo>
Oct 20 14:45:28 user nova-compute[76870]:   <os>
Oct 20 14:45:28 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:45:28 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:45:28 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:45:28 user nova-compute[76870]:   </os>
Oct 20 14:45:28 user nova-compute[76870]:   <features>
Oct 20 14:45:28 user nova-compute[76870]:     <acpi/>
Oct 20 14:45:28 user nova-compute[76870]:     <apic/>
Oct 20 14:45:28 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:45:28 user nova-compute[76870]:   </features>
Oct 20 14:45:28 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:45:28 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:45:28 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:45:28 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:45:28 user nova-compute[76870]:   </clock>
Oct 20 14:45:28 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:45:28 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:45:28 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:45:28 user nova-compute[76870]:   </cpu>
Oct 20 14:45:28 user nova-compute[76870]:   <devices>
Oct 20 14:45:28 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:45:28 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:45:28 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk"/>
Oct 20 14:45:28 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:45:28 user nova-compute[76870]:     </disk>
Oct 20 14:45:28 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:45:28 user nova-compute[76870]:       <mac address="fa:16:3e:3f:c4:57"/>
Oct 20 14:45:28 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:28 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:45:28 user nova-compute[76870]:       <target dev="tap2a22331f-1c"/>
Oct 20 14:45:28 user nova-compute[76870]:     </interface>
Oct 20 14:45:28 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:45:28 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/console.log" append="off"/>
Oct 20 14:45:28 user nova-compute[76870]:     </serial>
Oct 20 14:45:28 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:45:28 user nova-compute[76870]:     <video>
Oct 20 14:45:28 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:28 user nova-compute[76870]:     </video>
Oct 20 14:45:28 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:45:28 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:45:28 user nova-compute[76870]:     </rng>
Oct 20 14:45:28 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:45:28 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:45:28 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:45:28 user nova-compute[76870]:     </memballoon>
Oct 20 14:45:28 user nova-compute[76870]:   </devices>
Oct 20 14:45:28 user nova-compute[76870]: </domain>
Oct 20 14:45:28 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-904147619',display_name='tempest-VolumesActionsTest-instance-904147619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-904147619',id=26,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='705d22169e9d4c33beaba01971d0e10d',ramdisk_id='',reservation_id='r-3phlvnhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1366356536',owner_user_name='tempest-VolumesActionsTest-1366356536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:26Z,user_data=None,user_id='41ffa7bfd51042efb29a472a9aabfbf1',uuid=7f7f0d77-948f-4c3c-8308-1d8c531c6bff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converting VIF {"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG os_vif [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7349e7a3-7ae0-5bd1-98d9-46f411210fd2', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a22331f-1c, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a22331f-1c, col_values=(('qos', UUID('eb6da7b1-3827-4a45-acb7-417d43af248d')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a22331f-1c, col_values=(('external_ids', {'iface-id': '2a22331f-1c5d-4533-a3ce-f9813a1fda55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:c4:57', 'vm-uuid': '7f7f0d77-948f-4c3c-8308-1d8c531c6bff'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:28 user nova-compute[76870]: INFO os_vif [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c')
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] No VIF found with MAC fa:16:3e:3f:c4:57, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Updated VIF entry in instance network info cache for port 2a22331f-1c5d-4533-a3ce-f9813a1fda55. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Updating instance_info_cache with network_info: [{"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-11395b80-a30d-4fab-a68e-60864de52d38 req-b08863a9-8a14-4309-b6c1-31f00d538ad7 service nova] Releasing lock "refresh_cache-7f7f0d77-948f-4c3c-8308-1d8c531c6bff" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-3e57733e-8d3f-4f8a-8dda-5276312f76b3 req-f1d6c4d9-fa3a-4387-b655-396789625e6a service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3e57733e-8d3f-4f8a-8dda-5276312f76b3 req-f1d6c4d9-fa3a-4387-b655-396789625e6a service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3e57733e-8d3f-4f8a-8dda-5276312f76b3 req-f1d6c4d9-fa3a-4387-b655-396789625e6a service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3e57733e-8d3f-4f8a-8dda-5276312f76b3 req-f1d6c4d9-fa3a-4387-b655-396789625e6a service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-3e57733e-8d3f-4f8a-8dda-5276312f76b3 req-f1d6c4d9-fa3a-4387-b655-396789625e6a service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:29 user nova-compute[76870]: WARNING nova.compute.manager [req-3e57733e-8d3f-4f8a-8dda-5276312f76b3 req-f1d6c4d9-fa3a-4387-b655-396789625e6a service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state building and task_state spawning.
Oct 20 14:45:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:45:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:45:31 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Instance spawned successfully.
Oct 20 14:45:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:32 user nova-compute[76870]: INFO nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Took 5.64 seconds to spawn the instance on the hypervisor.
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-b21a42a0-f790-4afd-8f57-120daef9c47c req-2e3a888a-0008-46f0-a57d-9dc55ec8e5c0 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b21a42a0-f790-4afd-8f57-120daef9c47c req-2e3a888a-0008-46f0-a57d-9dc55ec8e5c0 service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b21a42a0-f790-4afd-8f57-120daef9c47c req-2e3a888a-0008-46f0-a57d-9dc55ec8e5c0 service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b21a42a0-f790-4afd-8f57-120daef9c47c req-2e3a888a-0008-46f0-a57d-9dc55ec8e5c0 service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-b21a42a0-f790-4afd-8f57-120daef9c47c req-2e3a888a-0008-46f0-a57d-9dc55ec8e5c0 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:32 user nova-compute[76870]: WARNING nova.compute.manager [req-b21a42a0-f790-4afd-8f57-120daef9c47c req-2e3a888a-0008-46f0-a57d-9dc55ec8e5c0 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state building and task_state spawning.
Oct 20 14:45:32 user nova-compute[76870]: INFO nova.compute.manager [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Took 6.47 seconds to build instance.
Oct 20 14:45:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e2e94c7a-3e56-4d03-aeca-31b23908fe56 tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.601s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:45:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:45:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:41 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:41 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7896MB free_disk=25.220035552978516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 231934b4-7eee-443f-bbf4-6253e3e9705c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f46d70-69fc-4985-ae20-1676a0efd8d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7399dd8d-e135-45f3-b414-55111ec046aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 4e56958e-edf4-4912-ac47-1ce9da96145f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7f7f0d77-948f-4c3c-8308-1d8c531c6bff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:45:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:45:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:43 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:45:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updating instance_info_cache with network_info: [{"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-2b929936-cca5-4c52-afa4-3c2e9b31284a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "0ef00916-b444-490b-a221-81f18276baaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:45:48 user nova-compute[76870]: INFO nova.compute.claims [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Claim successful on node user
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:45:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.policy [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdd157499df5446e8c082732e1fbd278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb2d2209f464235949db2d48ec8e2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:45:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Creating image(s)
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.210s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:45:49 user nova-compute[76870]: INFO nova.compute.claims [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Claim successful on node user
Oct 20 14:45:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk 1073741824" returned: 0 in 0.050s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Successfully created port: 845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Cannot resize image /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Ensure instance console log exists: /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:45:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:45:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.policy [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdd157499df5446e8c082732e1fbd278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb2d2209f464235949db2d48ec8e2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:45:50 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Creating image(s)
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Successfully updated port: 845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-changed-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Refreshing instance network info cache due to event network-changed-845e035b-f600-4801-91e4-da31116e9430. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.245s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.206s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Successfully created port: 49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk 1073741824" returned: 0 in 0.053s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance network_info: |[{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Refreshing network info cache for port 845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Start _get_guest_xml network_info=[{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:45:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107637266',display_name='tempest-ServerRescueNegativeTestJSON-server-1107637266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107637266',id=27,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-72q7sghr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:49Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=0ef00916-b444-490b-a221-81f18276baaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:45:50 user nova-compute[76870]:   <uuid>0ef00916-b444-490b-a221-81f18276baaa</uuid>
Oct 20 14:45:50 user nova-compute[76870]:   <name>instance-0000001b</name>
Oct 20 14:45:50 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:45:50 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:45:50 user nova-compute[76870]:   <metadata>
Oct 20 14:45:50 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:45:50 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:45:50 user nova-compute[76870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1107637266</nova:name>
Oct 20 14:45:50 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:45:50</nova:creationTime>
Oct 20 14:45:50 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:45:50 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:45:50 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:45:50 user nova-compute[76870]:       <nova:owner>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:user uuid="fdd157499df5446e8c082732e1fbd278">tempest-ServerRescueNegativeTestJSON-1475360384-project-member</nova:user>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:project uuid="5bb2d2209f464235949db2d48ec8e2eb">tempest-ServerRescueNegativeTestJSON-1475360384</nova:project>
Oct 20 14:45:50 user nova-compute[76870]:       </nova:owner>
Oct 20 14:45:50 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:45:50 user nova-compute[76870]:       <nova:ports>
Oct 20 14:45:50 user nova-compute[76870]:         <nova:port uuid="845e035b-f600-4801-91e4-da31116e9430">
Oct 20 14:45:50 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 14:45:50 user nova-compute[76870]:         </nova:port>
Oct 20 14:45:50 user nova-compute[76870]:       </nova:ports>
Oct 20 14:45:50 user nova-compute[76870]:     </nova:instance>
Oct 20 14:45:50 user nova-compute[76870]:   </metadata>
Oct 20 14:45:50 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:45:50 user nova-compute[76870]:     <system>
Oct 20 14:45:50 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:45:50 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:45:50 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:45:50 user nova-compute[76870]:       <entry name="serial">0ef00916-b444-490b-a221-81f18276baaa</entry>
Oct 20 14:45:50 user nova-compute[76870]:       <entry name="uuid">0ef00916-b444-490b-a221-81f18276baaa</entry>
Oct 20 14:45:50 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:45:50 user nova-compute[76870]:     </system>
Oct 20 14:45:50 user nova-compute[76870]:   </sysinfo>
Oct 20 14:45:50 user nova-compute[76870]:   <os>
Oct 20 14:45:50 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:45:50 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:45:50 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:45:50 user nova-compute[76870]:   </os>
Oct 20 14:45:50 user nova-compute[76870]:   <features>
Oct 20 14:45:50 user nova-compute[76870]:     <acpi/>
Oct 20 14:45:50 user nova-compute[76870]:     <apic/>
Oct 20 14:45:50 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:45:50 user nova-compute[76870]:   </features>
Oct 20 14:45:50 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:45:50 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:45:50 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:45:50 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:45:50 user nova-compute[76870]:   </clock>
Oct 20 14:45:50 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:45:50 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:45:50 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:45:50 user nova-compute[76870]:   </cpu>
Oct 20 14:45:50 user nova-compute[76870]:   <devices>
Oct 20 14:45:50 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:45:50 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:45:50 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk"/>
Oct 20 14:45:50 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:45:50 user nova-compute[76870]:     </disk>
Oct 20 14:45:50 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:45:50 user nova-compute[76870]:       <mac address="fa:16:3e:21:5a:d1"/>
Oct 20 14:45:50 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:50 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:45:50 user nova-compute[76870]:       <target dev="tap845e035b-f6"/>
Oct 20 14:45:50 user nova-compute[76870]:     </interface>
Oct 20 14:45:50 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:45:50 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/console.log" append="off"/>
Oct 20 14:45:50 user nova-compute[76870]:     </serial>
Oct 20 14:45:50 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:45:50 user nova-compute[76870]:     <video>
Oct 20 14:45:50 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:50 user nova-compute[76870]:     </video>
Oct 20 14:45:50 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:45:50 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:45:50 user nova-compute[76870]:     </rng>
Oct 20 14:45:50 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:45:50 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:45:50 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:45:50 user nova-compute[76870]:     </memballoon>
Oct 20 14:45:50 user nova-compute[76870]:   </devices>
Oct 20 14:45:50 user nova-compute[76870]: </domain>
Oct 20 14:45:50 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107637266',display_name='tempest-ServerRescueNegativeTestJSON-server-1107637266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107637266',id=27,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-72q7sghr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:49Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=0ef00916-b444-490b-a221-81f18276baaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG os_vif [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef29dfbf-4904-5367-b805-baeb1bd1a2ea', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap845e035b-f6, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap845e035b-f6, col_values=(('qos', UUID('290b194d-ae1c-4495-83be-991ab8f6f985')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap845e035b-f6, col_values=(('external_ids', {'iface-id': '845e035b-f600-4801-91e4-da31116e9430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:5a:d1', 'vm-uuid': '0ef00916-b444-490b-a221-81f18276baaa'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:50 user nova-compute[76870]: INFO os_vif [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6')
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:45:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:21:5a:d1, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Cannot resize image /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Ensure instance console log exists: /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updated VIF entry in instance network info cache for port 845e035b-f600-4801-91e4-da31116e9430. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b5e66d27-b5b2-40d3-8da6-6dacedbc7391 req-eeb2381f-1cbb-4555-b5e7-f5cfa8939d86 service nova] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Successfully updated port: 49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-changed-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Refreshing instance network info cache due to event network-changed-49af51a5-d47b-4bb9-842f-105bac22dae3. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] Acquiring lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance network_info: |[{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] Acquired lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Refreshing network info cache for port 49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Start _get_guest_xml network_info=[{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:45:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397882495',display_name='tempest-ServerRescueNegativeTestJSON-server-1397882495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397882495',id=28,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-cdxtuonh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:50Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=85c1fb0e-ae51-453e-9bbc-7f86370d44d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.objects.instance [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:45:51 user nova-compute[76870]:   <uuid>85c1fb0e-ae51-453e-9bbc-7f86370d44d4</uuid>
Oct 20 14:45:51 user nova-compute[76870]:   <name>instance-0000001c</name>
Oct 20 14:45:51 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:45:51 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:45:51 user nova-compute[76870]:   <metadata>
Oct 20 14:45:51 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:45:51 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:45:51 user nova-compute[76870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1397882495</nova:name>
Oct 20 14:45:51 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:45:51</nova:creationTime>
Oct 20 14:45:51 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:45:51 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:45:51 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:45:51 user nova-compute[76870]:       <nova:owner>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:user uuid="fdd157499df5446e8c082732e1fbd278">tempest-ServerRescueNegativeTestJSON-1475360384-project-member</nova:user>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:project uuid="5bb2d2209f464235949db2d48ec8e2eb">tempest-ServerRescueNegativeTestJSON-1475360384</nova:project>
Oct 20 14:45:51 user nova-compute[76870]:       </nova:owner>
Oct 20 14:45:51 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:45:51 user nova-compute[76870]:       <nova:ports>
Oct 20 14:45:51 user nova-compute[76870]:         <nova:port uuid="49af51a5-d47b-4bb9-842f-105bac22dae3">
Oct 20 14:45:51 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 14:45:51 user nova-compute[76870]:         </nova:port>
Oct 20 14:45:51 user nova-compute[76870]:       </nova:ports>
Oct 20 14:45:51 user nova-compute[76870]:     </nova:instance>
Oct 20 14:45:51 user nova-compute[76870]:   </metadata>
Oct 20 14:45:51 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:45:51 user nova-compute[76870]:     <system>
Oct 20 14:45:51 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:45:51 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:45:51 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:45:51 user nova-compute[76870]:       <entry name="serial">85c1fb0e-ae51-453e-9bbc-7f86370d44d4</entry>
Oct 20 14:45:51 user nova-compute[76870]:       <entry name="uuid">85c1fb0e-ae51-453e-9bbc-7f86370d44d4</entry>
Oct 20 14:45:51 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:45:51 user nova-compute[76870]:     </system>
Oct 20 14:45:51 user nova-compute[76870]:   </sysinfo>
Oct 20 14:45:51 user nova-compute[76870]:   <os>
Oct 20 14:45:51 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:45:51 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:45:51 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:45:51 user nova-compute[76870]:   </os>
Oct 20 14:45:51 user nova-compute[76870]:   <features>
Oct 20 14:45:51 user nova-compute[76870]:     <acpi/>
Oct 20 14:45:51 user nova-compute[76870]:     <apic/>
Oct 20 14:45:51 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:45:51 user nova-compute[76870]:   </features>
Oct 20 14:45:51 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:45:51 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:45:51 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:45:51 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:45:51 user nova-compute[76870]:   </clock>
Oct 20 14:45:51 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:45:51 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:45:51 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:45:51 user nova-compute[76870]:   </cpu>
Oct 20 14:45:51 user nova-compute[76870]:   <devices>
Oct 20 14:45:51 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:45:51 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:45:51 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk"/>
Oct 20 14:45:51 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:45:51 user nova-compute[76870]:     </disk>
Oct 20 14:45:51 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:45:51 user nova-compute[76870]:       <mac address="fa:16:3e:7f:28:25"/>
Oct 20 14:45:51 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:51 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:45:51 user nova-compute[76870]:       <target dev="tap49af51a5-d4"/>
Oct 20 14:45:51 user nova-compute[76870]:     </interface>
Oct 20 14:45:51 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:45:51 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/console.log" append="off"/>
Oct 20 14:45:51 user nova-compute[76870]:     </serial>
Oct 20 14:45:51 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:45:51 user nova-compute[76870]:     <video>
Oct 20 14:45:51 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:45:51 user nova-compute[76870]:     </video>
Oct 20 14:45:51 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:45:51 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:45:51 user nova-compute[76870]:     </rng>
Oct 20 14:45:51 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:45:51 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:45:51 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:45:51 user nova-compute[76870]:     </memballoon>
Oct 20 14:45:51 user nova-compute[76870]:   </devices>
Oct 20 14:45:51 user nova-compute[76870]: </domain>
Oct 20 14:45:51 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397882495',display_name='tempest-ServerRescueNegativeTestJSON-server-1397882495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397882495',id=28,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-cdxtuonh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:50Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=85c1fb0e-ae51-453e-9bbc-7f86370d44d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG os_vif [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab9fed0b-d9be-5549-aeaa-422985caec54', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49af51a5-d4, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49af51a5-d4, col_values=(('qos', UUID('d5063f1c-ef26-4731-a983-a3919a240d1a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49af51a5-d4, col_values=(('external_ids', {'iface-id': '49af51a5-d47b-4bb9-842f-105bac22dae3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:28:25', 'vm-uuid': '85c1fb0e-ae51-453e-9bbc-7f86370d44d4'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:51 user nova-compute[76870]: INFO os_vif [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4')
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:45:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:7f:28:25, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG nova.network.neutron [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updated VIF entry in instance network info cache for port 49af51a5-d47b-4bb9-842f-105bac22dae3. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG nova.network.neutron [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a956916f-2b52-4a8c-9115-f341d67c8691 req-bc83641b-38ad-4f03-9b86-435954b6202a service nova] Releasing lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-fc71620f-5722-41fc-98ab-348d71c4dacd req-fd25e3a0-29a9-4a4e-876c-4224690e1654 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fc71620f-5722-41fc-98ab-348d71c4dacd req-fd25e3a0-29a9-4a4e-876c-4224690e1654 service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fc71620f-5722-41fc-98ab-348d71c4dacd req-fd25e3a0-29a9-4a4e-876c-4224690e1654 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fc71620f-5722-41fc-98ab-348d71c4dacd req-fd25e3a0-29a9-4a4e-876c-4224690e1654 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-fc71620f-5722-41fc-98ab-348d71c4dacd req-fd25e3a0-29a9-4a4e-876c-4224690e1654 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:52 user nova-compute[76870]: WARNING nova.compute.manager [req-fc71620f-5722-41fc-98ab-348d71c4dacd req-fd25e3a0-29a9-4a4e-876c-4224690e1654 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state building and task_state spawning.
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:54 user nova-compute[76870]: WARNING nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state building and task_state spawning.
Oct 20 14:45:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:54 user nova-compute[76870]: WARNING nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state building and task_state spawning.
Oct 20 14:45:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:45:54 user nova-compute[76870]: WARNING nova.compute.manager [req-76140b83-1584-44e5-960c-99fb2744bf39 req-fd5fb483-ab14-450f-b747-902bdd1ad25f service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state building and task_state spawning.
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:45:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance spawned successfully.
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:45:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance spawned successfully.
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:45:56 user nova-compute[76870]: INFO nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Took 7.23 seconds to spawn the instance on the hypervisor.
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:45:56 user nova-compute[76870]: INFO nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 20 14:45:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:45:56 user nova-compute[76870]: INFO nova.compute.manager [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Took 7.00 seconds to build instance.
Oct 20 14:45:56 user nova-compute[76870]: INFO nova.compute.manager [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Took 7.95 seconds to build instance.
Oct 20 14:45:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-66a5e0d2-c1bc-47a9-aa51-181b44192854 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.126s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f0071189-8225-4bb1-b9c8-7d76c9330ccb tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "0ef00916-b444-490b-a221-81f18276baaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.059s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:45:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:45:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-changed-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Refreshing instance network info cache due to event network-changed-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] Acquiring lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] Acquired lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Refreshing network info cache for port 8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updated VIF entry in instance network info cache for port 8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updating instance_info_cache with network_info: [{"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b95175b0-0d81-4f02-9f36-a6f0af5501cb req-10a17796-7d37-4305-99ca-ed3de1d65b56 service nova] Releasing lock "refresh_cache-7399dd8d-e135-45f3-b414-55111ec046aa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:46:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:02 user nova-compute[76870]: INFO nova.compute.manager [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Terminating instance
Oct 20 14:46:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-767ece21-7395-4069-b2fc-99fea89da38a req-2694ca3c-ee02-4a5a-9cc4-7e32d9ed69fb service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-vif-unplugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-767ece21-7395-4069-b2fc-99fea89da38a req-2694ca3c-ee02-4a5a-9cc4-7e32d9ed69fb service nova] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-767ece21-7395-4069-b2fc-99fea89da38a req-2694ca3c-ee02-4a5a-9cc4-7e32d9ed69fb service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-767ece21-7395-4069-b2fc-99fea89da38a req-2694ca3c-ee02-4a5a-9cc4-7e32d9ed69fb service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-767ece21-7395-4069-b2fc-99fea89da38a req-2694ca3c-ee02-4a5a-9cc4-7e32d9ed69fb service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] No waiting events found dispatching network-vif-unplugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-767ece21-7395-4069-b2fc-99fea89da38a req-2694ca3c-ee02-4a5a-9cc4-7e32d9ed69fb service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-vif-unplugged-fce751c5-80f8-4d1e-a29d-623908124d21 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:46:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Instance destroyed successfully.
Oct 20 14:46:03 user nova-compute[76870]: DEBUG nova.objects.instance [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'resources' on Instance uuid f5f46d70-69fc-4985-ae20-1676a0efd8d0 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2045777051',display_name='tempest-TestMinimumBasicScenario-server-2045777051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2045777051',id=20,image_ref='587a3c13-319f-4473-869f-8a503395377e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2uE8cGA8bmWI7rC9wUi55d1zc4dsXr35M5Ko9PuNTvH9Q0YxMh8rKpoJLDdRbcqTE36LnI4G9iDFGnm8d4sfT1RpDWah7a8HcO7x83UTPnjze/RuyKQWh2fEZ0n3A79Q==',key_name='tempest-TestMinimumBasicScenario-455146338',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0587d1c60494c99b9925d303898f203',ramdisk_id='',reservation_id='r-rqjf916u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='587a3c13-319f-4473-869f-8a503395377e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1438762037',owner_user_name='tempest-TestMinimumBasicScenario-1438762037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:40:46Z,user_data=None,user_id='9ce9bea46975483190038bf47a226ced',uuid=f5f46d70-69fc-4985-ae20-1676a0efd8d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converting VIF {"id": "fce751c5-80f8-4d1e-a29d-623908124d21", "address": "fa:16:3e:64:c1:92", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce751c5-80", "ovs_interfaceid": "fce751c5-80f8-4d1e-a29d-623908124d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG os_vif [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfce751c5-80, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68962833-8edc-4e7c-828b-8eb5f9cdae71) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:03 user nova-compute[76870]: INFO os_vif [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c1:92,bridge_name='br-int',has_traffic_filtering=True,id=fce751c5-80f8-4d1e-a29d-623908124d21,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce751c5-80')
Oct 20 14:46:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Deleting instance files /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0_del
Oct 20 14:46:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Deletion of /opt/stack/data/nova/instances/f5f46d70-69fc-4985-ae20-1676a0efd8d0_del complete
Oct 20 14:46:03 user nova-compute[76870]: INFO nova.compute.manager [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 14:46:03 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:46:03 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:04 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Took 0.75 seconds to deallocate network for instance.
Oct 20 14:46:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-ad9b27b5-4b36-4e4a-a83f-917cf64dac80 req-a75c84b2-1e60-460e-a922-0789facb3da1 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-vif-deleted-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:46:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:04 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Deleted allocations for instance f5f46d70-69fc-4985-ae20-1676a0efd8d0
Oct 20 14:46:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-593891b6-db86-44b7-beb8-26b5e50d8428 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-3a0edb59-fb58-4ea3-b76b-f4554e6baca8 req-5cd2635f-c7dd-4349-953b-95f37735a7a3 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received event network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3a0edb59-fb58-4ea3-b76b-f4554e6baca8 req-5cd2635f-c7dd-4349-953b-95f37735a7a3 service nova] Acquiring lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3a0edb59-fb58-4ea3-b76b-f4554e6baca8 req-5cd2635f-c7dd-4349-953b-95f37735a7a3 service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3a0edb59-fb58-4ea3-b76b-f4554e6baca8 req-5cd2635f-c7dd-4349-953b-95f37735a7a3 service nova] Lock "f5f46d70-69fc-4985-ae20-1676a0efd8d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-3a0edb59-fb58-4ea3-b76b-f4554e6baca8 req-5cd2635f-c7dd-4349-953b-95f37735a7a3 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] No waiting events found dispatching network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:05 user nova-compute[76870]: WARNING nova.compute.manager [req-3a0edb59-fb58-4ea3-b76b-f4554e6baca8 req-5cd2635f-c7dd-4349-953b-95f37735a7a3 service nova] [instance: f5f46d70-69fc-4985-ae20-1676a0efd8d0] Received unexpected event network-vif-plugged-fce751c5-80f8-4d1e-a29d-623908124d21 for instance with vm_state deleted and task_state None.
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG nova.objects.instance [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:07 user nova-compute[76870]: INFO nova.compute.manager [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Attaching volume 2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 to /dev/vdb
Oct 20 14:46:07 user nova-compute[76870]: DEBUG os_brick.utils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[11604693-f35a-4b5a-8c95-602180487fac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d5b39-63e9-4225-a84e-0429805c63c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5759f826-a218-4ee5-8830-aa226c844f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e2f0c-91c9-4b5b-925d-53586d9ead36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:46:07 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:46:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11a6773-44b3-435f-825e-bac0637df156]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG os_brick.utils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:46:07 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updating existing volume attachment record: 5a768146-6635-48ac-a67e-ccaca2544ad2 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:46:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:09 user nova-compute[76870]: INFO nova.compute.manager [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Terminating instance
Oct 20 14:46:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-30887d12-295e-4e02-b936-5a9bda1cd022 req-aa5ee2d4-898c-4982-97dc-9dbeba14a9b5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-30887d12-295e-4e02-b936-5a9bda1cd022 req-aa5ee2d4-898c-4982-97dc-9dbeba14a9b5 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-30887d12-295e-4e02-b936-5a9bda1cd022 req-aa5ee2d4-898c-4982-97dc-9dbeba14a9b5 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-30887d12-295e-4e02-b936-5a9bda1cd022 req-aa5ee2d4-898c-4982-97dc-9dbeba14a9b5 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-30887d12-295e-4e02-b936-5a9bda1cd022 req-aa5ee2d4-898c-4982-97dc-9dbeba14a9b5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-30887d12-295e-4e02-b936-5a9bda1cd022 req-aa5ee2d4-898c-4982-97dc-9dbeba14a9b5 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Instance destroyed successfully.
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'resources' on Instance uuid 231934b4-7eee-443f-bbf4-6253e3e9705c {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-573954456',display_name='tempest-AttachVolumeTestJSON-server-573954456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-573954456',id=12,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU1AxOqjTQ6qfSFZ/8eig5bSfawTmYMVlQTvp74eYt37CcT8/BOmPvPNR49PU79RwlI99LyGpklU2fc9M+l0Ep3ai3m8yUkyAlz6PmNN/QcgDzj8pVo+gNsbXPS2arG5Q==',key_name='tempest-keypair-1920500823',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-v0lmnxqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=231934b4-7eee-443f-bbf4-6253e3e9705c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "9baeaf20-f156-4777-a8cf-c85722913a76", "address": "fa:16:3e:1f:2b:34", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9baeaf20-f1", "ovs_interfaceid": "9baeaf20-f156-4777-a8cf-c85722913a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG os_vif [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9baeaf20-f1, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8964c3fe-c994-46af-bf29-9e6d06d68f62) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:10 user nova-compute[76870]: INFO os_vif [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=9baeaf20-f156-4777-a8cf-c85722913a76,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9baeaf20-f1')
Oct 20 14:46:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Deleting instance files /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c_del
Oct 20 14:46:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Deletion of /opt/stack/data/nova/instances/231934b4-7eee-443f-bbf4-6253e3e9705c_del complete
Oct 20 14:46:10 user nova-compute[76870]: INFO nova.compute.manager [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 20 14:46:10 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:46:10 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:11 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Took 0.93 seconds to deallocate network for instance.
Oct 20 14:46:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-95d461bb-44bc-4d45-8f7a-092ede9749f3 req-b19a3aa2-c742-458a-95d4-61c3dda4fa52 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-deleted-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:11 user nova-compute[76870]: INFO nova.compute.manager [req-95d461bb-44bc-4d45-8f7a-092ede9749f3 req-b19a3aa2-c742-458a-95d4-61c3dda4fa52 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Neutron deleted interface 9baeaf20-f156-4777-a8cf-c85722913a76; detaching it from the instance and deleting it from the info cache
Oct 20 14:46:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-95d461bb-44bc-4d45-8f7a-092ede9749f3 req-b19a3aa2-c742-458a-95d4-61c3dda4fa52 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-95d461bb-44bc-4d45-8f7a-092ede9749f3 req-b19a3aa2-c742-458a-95d4-61c3dda4fa52 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Detach interface failed, port_id=9baeaf20-f156-4777-a8cf-c85722913a76, reason: Instance 231934b4-7eee-443f-bbf4-6253e3e9705c could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Deleted allocations for instance 231934b4-7eee-443f-bbf4-6253e3e9705c
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b159f691-5289-4b4b-b96d-28697b8a1c08 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:12 user nova-compute[76870]: WARNING nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state deleted and task_state None.
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:12 user nova-compute[76870]: WARNING nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state deleted and task_state None.
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:12 user nova-compute[76870]: WARNING nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state deleted and task_state None.
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:12 user nova-compute[76870]: WARNING nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-unplugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state deleted and task_state None.
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Acquiring lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] Lock "231934b4-7eee-443f-bbf4-6253e3e9705c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] No waiting events found dispatching network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:12 user nova-compute[76870]: WARNING nova.compute.manager [req-1c89e8e2-0a84-48b9-9c83-5cd7a7b027bc req-a5e089a6-ffcb-44d1-88cc-aa3f628d4754 service nova] [instance: 231934b4-7eee-443f-bbf4-6253e3e9705c] Received unexpected event network-vif-plugged-9baeaf20-f156-4777-a8cf-c85722913a76 for instance with vm_state deleted and task_state None.
Oct 20 14:46:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:46:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:46:26 user nova-compute[76870]: INFO nova.compute.claims [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Claim successful on node user
Oct 20 14:46:26 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:46:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:46:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Creating image(s)
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "/opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "/opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.policy [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f7b1202b96045c2939d41639118d7ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b99632d22924259ba135054b103399a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk 1073741824" returned: 0 in 0.049s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:46:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Successfully created port: b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Cannot resize image /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Ensure instance console log exists: /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Successfully updated port: b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquired lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-changed-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Refreshing instance network info cache due to event network-changed-b6790ddf-f3fd-4d20-b348-1f1881405cde. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] Acquiring lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:46:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updating instance_info_cache with network_info: [{"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Releasing lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Instance network_info: |[{"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] Acquired lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Refreshing network info cache for port b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Start _get_guest_xml network_info=[{"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:46:29 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:46:29 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1850568',id=29,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEX/bFYBQ0hDgt1VuvzHNKsyPd8yZQRet0jgcG7fr4xuGgRNrGM/Dux34Tq4F+g8ooH2YWhldoURbtG9FREDsH3py+PQM/572s0AfLlGrofZMIGqU9zY2CRn7xsJEnpfA==',key_name='tempest-keypair-1901193495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b99632d22924259ba135054b103399a',ramdisk_id='',reservation_id='r-qzc643jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1260542710',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f7b1202b96045c2939d41639118d7ad',uuid=f6030b28-c422-408a-b1b2-5066fd2ea32f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Converting VIF {"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.objects.instance [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lazy-loading 'pci_devices' on Instance uuid f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:46:29 user nova-compute[76870]:   <uuid>f6030b28-c422-408a-b1b2-5066fd2ea32f</uuid>
Oct 20 14:46:29 user nova-compute[76870]:   <name>instance-0000001d</name>
Oct 20 14:46:29 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:46:29 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:46:29 user nova-compute[76870]:   <metadata>
Oct 20 14:46:29 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:46:29 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:46:29 user nova-compute[76870]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706</nova:name>
Oct 20 14:46:29 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:46:29</nova:creationTime>
Oct 20 14:46:29 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:46:29 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:46:29 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:46:29 user nova-compute[76870]:       <nova:owner>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:user uuid="6f7b1202b96045c2939d41639118d7ad">tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member</nova:user>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:project uuid="3b99632d22924259ba135054b103399a">tempest-TestServerVolumeAttachScenarioOldVersion-1260542710</nova:project>
Oct 20 14:46:29 user nova-compute[76870]:       </nova:owner>
Oct 20 14:46:29 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:46:29 user nova-compute[76870]:       <nova:ports>
Oct 20 14:46:29 user nova-compute[76870]:         <nova:port uuid="b6790ddf-f3fd-4d20-b348-1f1881405cde">
Oct 20 14:46:29 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 14:46:29 user nova-compute[76870]:         </nova:port>
Oct 20 14:46:29 user nova-compute[76870]:       </nova:ports>
Oct 20 14:46:29 user nova-compute[76870]:     </nova:instance>
Oct 20 14:46:29 user nova-compute[76870]:   </metadata>
Oct 20 14:46:29 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:46:29 user nova-compute[76870]:     <system>
Oct 20 14:46:29 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:46:29 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:46:29 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:46:29 user nova-compute[76870]:       <entry name="serial">f6030b28-c422-408a-b1b2-5066fd2ea32f</entry>
Oct 20 14:46:29 user nova-compute[76870]:       <entry name="uuid">f6030b28-c422-408a-b1b2-5066fd2ea32f</entry>
Oct 20 14:46:29 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:46:29 user nova-compute[76870]:     </system>
Oct 20 14:46:29 user nova-compute[76870]:   </sysinfo>
Oct 20 14:46:29 user nova-compute[76870]:   <os>
Oct 20 14:46:29 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:46:29 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:46:29 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:46:29 user nova-compute[76870]:   </os>
Oct 20 14:46:29 user nova-compute[76870]:   <features>
Oct 20 14:46:29 user nova-compute[76870]:     <acpi/>
Oct 20 14:46:29 user nova-compute[76870]:     <apic/>
Oct 20 14:46:29 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:46:29 user nova-compute[76870]:   </features>
Oct 20 14:46:29 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:46:29 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:46:29 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:46:29 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:46:29 user nova-compute[76870]:   </clock>
Oct 20 14:46:29 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:46:29 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:46:29 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:46:29 user nova-compute[76870]:   </cpu>
Oct 20 14:46:29 user nova-compute[76870]:   <devices>
Oct 20 14:46:29 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:46:29 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:46:29 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk"/>
Oct 20 14:46:29 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:46:29 user nova-compute[76870]:     </disk>
Oct 20 14:46:29 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:46:29 user nova-compute[76870]:       <mac address="fa:16:3e:40:cf:a5"/>
Oct 20 14:46:29 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:46:29 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:46:29 user nova-compute[76870]:       <target dev="tapb6790ddf-f3"/>
Oct 20 14:46:29 user nova-compute[76870]:     </interface>
Oct 20 14:46:29 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:46:29 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/console.log" append="off"/>
Oct 20 14:46:29 user nova-compute[76870]:     </serial>
Oct 20 14:46:29 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:46:29 user nova-compute[76870]:     <video>
Oct 20 14:46:29 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:46:29 user nova-compute[76870]:     </video>
Oct 20 14:46:29 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:46:29 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:46:29 user nova-compute[76870]:     </rng>
Oct 20 14:46:29 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:46:29 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:46:29 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:46:29 user nova-compute[76870]:     </memballoon>
Oct 20 14:46:29 user nova-compute[76870]:   </devices>
Oct 20 14:46:29 user nova-compute[76870]: </domain>
Oct 20 14:46:29 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1850568',id=29,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEX/bFYBQ0hDgt1VuvzHNKsyPd8yZQRet0jgcG7fr4xuGgRNrGM/Dux34Tq4F+g8ooH2YWhldoURbtG9FREDsH3py+PQM/572s0AfLlGrofZMIGqU9zY2CRn7xsJEnpfA==',key_name='tempest-keypair-1901193495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b99632d22924259ba135054b103399a',ramdisk_id='',reservation_id='r-qzc643jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1260542710',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f7b1202b96045c2939d41639118d7ad',uuid=f6030b28-c422-408a-b1b2-5066fd2ea32f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Converting VIF {"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG os_vif [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67fb2b5f-d337-5c82-836e-a620debfcd28', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6790ddf-f3, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6790ddf-f3, col_values=(('qos', UUID('5146643f-4de6-4c34-9af8-ae68a1095cad')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6790ddf-f3, col_values=(('external_ids', {'iface-id': 'b6790ddf-f3fd-4d20-b348-1f1881405cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:cf:a5', 'vm-uuid': 'f6030b28-c422-408a-b1b2-5066fd2ea32f'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:29 user nova-compute[76870]: INFO os_vif [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3')
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] No VIF found with MAC fa:16:3e:40:cf:a5, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updated VIF entry in instance network info cache for port b6790ddf-f3fd-4d20-b348-1f1881405cde. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG nova.network.neutron [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updating instance_info_cache with network_info: [{"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c015b2f5-dfbb-42da-a986-a3ef8e9edd1f req-e5059130-2533-40cb-8ae9-63b5832ea650 service nova] Releasing lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:46:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-3f07a5a5-2ff1-45f7-8bf2-e4e0029307c2 req-fd43177b-df4d-416c-8b41-03ad6c356a7a service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3f07a5a5-2ff1-45f7-8bf2-e4e0029307c2 req-fd43177b-df4d-416c-8b41-03ad6c356a7a service nova] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3f07a5a5-2ff1-45f7-8bf2-e4e0029307c2 req-fd43177b-df4d-416c-8b41-03ad6c356a7a service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3f07a5a5-2ff1-45f7-8bf2-e4e0029307c2 req-fd43177b-df4d-416c-8b41-03ad6c356a7a service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-3f07a5a5-2ff1-45f7-8bf2-e4e0029307c2 req-fd43177b-df4d-416c-8b41-03ad6c356a7a service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] No waiting events found dispatching network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:30 user nova-compute[76870]: WARNING nova.compute.manager [req-3f07a5a5-2ff1-45f7-8bf2-e4e0029307c2 req-fd43177b-df4d-416c-8b41-03ad6c356a7a service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received unexpected event network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde for instance with vm_state building and task_state spawning.
Oct 20 14:46:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:46:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Instance spawned successfully.
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d25690c-90b4-4780-809b-a6db8caf8e4b req-46390457-0356-4920-a989-37f33a99fcb4 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d25690c-90b4-4780-809b-a6db8caf8e4b req-46390457-0356-4920-a989-37f33a99fcb4 service nova] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d25690c-90b4-4780-809b-a6db8caf8e4b req-46390457-0356-4920-a989-37f33a99fcb4 service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d25690c-90b4-4780-809b-a6db8caf8e4b req-46390457-0356-4920-a989-37f33a99fcb4 service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d25690c-90b4-4780-809b-a6db8caf8e4b req-46390457-0356-4920-a989-37f33a99fcb4 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] No waiting events found dispatching network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:46:32 user nova-compute[76870]: WARNING nova.compute.manager [req-0d25690c-90b4-4780-809b-a6db8caf8e4b req-46390457-0356-4920-a989-37f33a99fcb4 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received unexpected event network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde for instance with vm_state building and task_state spawning.
Oct 20 14:46:32 user nova-compute[76870]: INFO nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 20 14:46:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:46:32 user nova-compute[76870]: INFO nova.compute.manager [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Took 6.26 seconds to build instance.
Oct 20 14:46:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-aee63b0a-7a5a-40d9-85f0-fe2a6a4ac5a2 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.358s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGbaPHWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:46:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:46:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:46:34 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ce62b-0094-4805-a6b4-f6d648c7e0d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:46:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90999c11-aec9-46a9-9122-837098ff5902]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5] added
Oct 20 14:46:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65cd654-ca19-4ff7-9db9-6fb3507a1bf0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fe24eb-cbee-4006-8419-8028233ff56f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGbaPHWA {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGbaPHWA" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2598e2-8215-4270-9e89-cd1434ace59f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kGbaPHWA'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e147cd8-1515-4c2a-a9b7-365a5700299e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b303845-786c-4ac7-9e8c-9964b307384d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:46:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:46:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:46:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 14:46:34 user nova-compute[76870]: 
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90880167-8450-4eff-929d-c8b8fc1276f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260]
Oct 20 14:46:34 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260] successful.
Oct 20 14:46:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc5936-3b4f-47ba-9979-75f3b4dfaa84]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[09da90a6-ce48-41de-8a4b-8261f90846b6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 (non-flash)
Oct 20 14:46:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 (non-flash)
Oct 20 14:46:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecfb156-b319-413d-b90e-21889f233fd8]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:46:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGbaPHWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:46:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:46:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26636656634623730', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:46:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636656634623730', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:46:35 user nova-compute[76870]: DEBUG nova.objects.instance [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:46:35 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:46:35 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:46:35 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:46:35 user nova-compute[76870]:   <serial>2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5</serial>
Oct 20 14:46:35 user nova-compute[76870]: </disk>
Oct 20 14:46:35 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:46:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:46:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:46:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:c0:94:54, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:46:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d6caf5d1-68bf-4cbf-8cb0-60f287d66b97 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.572s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:37 user nova-compute[76870]: INFO nova.compute.manager [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Detaching volume 2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5
Oct 20 14:46:37 user nova-compute[76870]: INFO nova.virt.block_device [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Attempting to driver detach volume 2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 from mountpoint /dev/vdb
Oct 20 14:46:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Attempting to detach device vdb from instance 7399dd8d-e135-45f3-b414-55111ec046aa from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:46:37 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:46:37 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:46:37 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:46:37 user nova-compute[76870]:   <serial>2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5</serial>
Oct 20 14:46:37 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:46:37 user nova-compute[76870]: </disk>
Oct 20 14:46:37 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:46:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully detached device vdb from instance 7399dd8d-e135-45f3-b414-55111ec046aa from the persistent domain config.
Oct 20 14:46:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7399dd8d-e135-45f3-b414-55111ec046aa from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:46:37 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:46:37 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:46:37 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:46:37 user nova-compute[76870]:   <serial>2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5</serial>
Oct 20 14:46:37 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:46:37 user nova-compute[76870]: </disk>
Oct 20 14:46:37 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 14:46:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:46:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:43 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:46:43 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=25.176345825195312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7399dd8d-e135-45f3-b414-55111ec046aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 4e56958e-edf4-4912-ac47-1ce9da96145f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7f7f0d77-948f-4c3c-8308-1d8c531c6bff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f6030b28-c422-408a-b1b2-5066fd2ea32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 14:46:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 2 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 14:46:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deletion of /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize failed
Oct 20 14:46:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:46:47 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:46:49 user nova-compute[76870]: WARNING nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 2b929936-cca5-4c52-afa4-3c2e9b31284a {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 7f7f0d77-948f-4c3c-8308-1d8c531c6bff {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 663ff166-5934-49b0-bb00-4600c1c31b08 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "0ef00916-b444-490b-a221-81f18276baaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "0ef00916-b444-490b-a221-81f18276baaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: INFO nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:46:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:56 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:46:56 user nova-compute[76870]: INFO nova.compute.claims [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Claim successful on node user
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:46:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:46:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Creating image(s)
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "/opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "/opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "/opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "34cd2e279cc912ec498a8d0f29c2411448a252bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "34cd2e279cc912ec498a8d0f29c2411448a252bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG nova.policy [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce9bea46975483190038bf47a226ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0587d1c60494c99b9925d303898f203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:46:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7399dd8d-e135-45f3-b414-55111ec046aa is timed out.
Oct 20 14:46:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully detached device vdb from instance 7399dd8d-e135-45f3-b414-55111ec046aa from the live domain config.
Oct 20 14:46:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGbaPHWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:46:58 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e11a2-7abf-4203-8b67-1f0473bbcf16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:46:58 user nova-compute[76870]: No targets found.
Oct 20 14:46:58 user nova-compute[76870]: iSNS:
Oct 20 14:46:58 user nova-compute[76870]: No targets found.
Oct 20 14:46:58 user nova-compute[76870]: STATIC:
Oct 20 14:46:58 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5
Oct 20 14:46:58 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:46:58 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:46:58 user nova-compute[76870]: FIRMWARE:
Oct 20 14:46:58 user nova-compute[76870]: No targets found.
Oct 20 14:46:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:46:58 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:46:58 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931985b-5db4-4840-88f2-e599b6a0097d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf2b8c-430a-4356-b51c-d395257378bb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 (non-flash)
Oct 20 14:46:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 (non-flash)
Oct 20 14:46:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf85930a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a41422a-2d08-4d80-aad5-bd302782237c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.part --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG nova.virt.images [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] 5aea4786-dcd3-486d-a5bc-d915e6d9a4b2 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.part /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[927cf693-861d-439d-b968-722cb7f802b9]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc250229-5f76-4125-9272-24a5104c18d9]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e4b9a-8d35-4708-9259-954e8e1cb5d3]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71048588-59d8-49ae-b216-bf7e761bd402]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.205s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[293459ba-7ccd-49fb-a27f-ba33145b2c5f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260]
Oct 20 14:46:58 user nova-compute[76870]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5, portal: 172.16.0.220,3260] successful.
Oct 20 14:46:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2186d9d9-14b5-4aa9-80c1-fbcd01fcb2c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fe710-280f-4705-8c3e-cabc5013bbb3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== disconnect_volume: return (492ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Successfully created port: be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.part /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.converted" returned: 0 in 0.687s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "34cd2e279cc912ec498a8d0f29c2411448a252bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.483s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf --force-share --output=json" returned: 0 in 0.210s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "34cd2e279cc912ec498a8d0f29c2411448a252bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "34cd2e279cc912ec498a8d0f29c2411448a252bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Successfully updated port: be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.compute.manager [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.compute.manager [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing instance network info cache due to event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f4773a91-297a-43fc-8ebb-82ba4d635aaf tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.809s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf,backing_fmt=raw /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf,backing_fmt=raw /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk 1073741824" returned: 0 in 0.064s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "34cd2e279cc912ec498a8d0f29c2411448a252bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance network_info: |[{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.neutron [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Cannot resize image /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Ensure instance console log exists: /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Start _get_guest_xml network_info=[{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:46:54Z,direct_url=<?>,disk_format='qcow2',id=5aea4786-dcd3-486d-a5bc-d915e6d9a4b2,min_disk=0,min_ram=0,name='tempest-scenario-img--2014333345',owner='a0587d1c60494c99b9925d303898f203',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:46:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '5aea4786-dcd3-486d-a5bc-d915e6d9a4b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:46:59 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:46:59 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:46:54Z,direct_url=<?>,disk_format='qcow2',id=5aea4786-dcd3-486d-a5bc-d915e6d9a4b2,min_disk=0,min_ram=0,name='tempest-scenario-img--2014333345',owner='a0587d1c60494c99b9925d303898f203',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:46:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-126319092',display_name='tempest-TestMinimumBasicScenario-server-126319092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-126319092',id=30,image_ref='5aea4786-dcd3-486d-a5bc-d915e6d9a4b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHNEyBbQHpCXb5WVNW47N862wE3gEAbINjYbQh728tUs4LASgdToY9W99CeyK6TDi9fachCRN8XbtUcA64EoX6c/1t5JUF0aDfvdCDKbnQvpWIHoAXX7WbzuwtmvRWdw==',key_name='tempest-TestMinimumBasicScenario-687725015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0587d1c60494c99b9925d303898f203',ramdisk_id='',reservation_id='r-rht75m7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5aea4786-dcd3-486d-a5bc-d915e6d9a4b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1438762037',owner_user_name='tempest-TestMinimumBasicScenario-1438762037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:46:57Z,user_data=None,user_id='9ce9bea46975483190038bf47a226ced',uuid=a16a3e38-cf87-4bb7-a0eb-e2e9537df659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converting VIF {"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'pci_devices' on Instance uuid a16a3e38-cf87-4bb7-a0eb-e2e9537df659 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:46:59 user nova-compute[76870]:   <uuid>a16a3e38-cf87-4bb7-a0eb-e2e9537df659</uuid>
Oct 20 14:46:59 user nova-compute[76870]:   <name>instance-0000001e</name>
Oct 20 14:46:59 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:46:59 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:46:59 user nova-compute[76870]:   <metadata>
Oct 20 14:46:59 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:46:59 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:46:59 user nova-compute[76870]:       <nova:name>tempest-TestMinimumBasicScenario-server-126319092</nova:name>
Oct 20 14:46:59 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:46:59</nova:creationTime>
Oct 20 14:46:59 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:46:59 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:46:59 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:46:59 user nova-compute[76870]:       <nova:owner>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:user uuid="9ce9bea46975483190038bf47a226ced">tempest-TestMinimumBasicScenario-1438762037-project-member</nova:user>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:project uuid="a0587d1c60494c99b9925d303898f203">tempest-TestMinimumBasicScenario-1438762037</nova:project>
Oct 20 14:46:59 user nova-compute[76870]:       </nova:owner>
Oct 20 14:46:59 user nova-compute[76870]:       <nova:root type="image" uuid="5aea4786-dcd3-486d-a5bc-d915e6d9a4b2"/>
Oct 20 14:46:59 user nova-compute[76870]:       <nova:ports>
Oct 20 14:46:59 user nova-compute[76870]:         <nova:port uuid="be363e4d-cc33-48a2-8f24-53e40c95f20d">
Oct 20 14:46:59 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 14:46:59 user nova-compute[76870]:         </nova:port>
Oct 20 14:46:59 user nova-compute[76870]:       </nova:ports>
Oct 20 14:46:59 user nova-compute[76870]:     </nova:instance>
Oct 20 14:46:59 user nova-compute[76870]:   </metadata>
Oct 20 14:46:59 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:46:59 user nova-compute[76870]:     <system>
Oct 20 14:46:59 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:46:59 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:46:59 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:46:59 user nova-compute[76870]:       <entry name="serial">a16a3e38-cf87-4bb7-a0eb-e2e9537df659</entry>
Oct 20 14:46:59 user nova-compute[76870]:       <entry name="uuid">a16a3e38-cf87-4bb7-a0eb-e2e9537df659</entry>
Oct 20 14:46:59 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:46:59 user nova-compute[76870]:     </system>
Oct 20 14:46:59 user nova-compute[76870]:   </sysinfo>
Oct 20 14:46:59 user nova-compute[76870]:   <os>
Oct 20 14:46:59 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:46:59 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:46:59 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:46:59 user nova-compute[76870]:   </os>
Oct 20 14:46:59 user nova-compute[76870]:   <features>
Oct 20 14:46:59 user nova-compute[76870]:     <acpi/>
Oct 20 14:46:59 user nova-compute[76870]:     <apic/>
Oct 20 14:46:59 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:46:59 user nova-compute[76870]:   </features>
Oct 20 14:46:59 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:46:59 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:46:59 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:46:59 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:46:59 user nova-compute[76870]:   </clock>
Oct 20 14:46:59 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:46:59 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:46:59 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:46:59 user nova-compute[76870]:   </cpu>
Oct 20 14:46:59 user nova-compute[76870]:   <devices>
Oct 20 14:46:59 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:46:59 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:46:59 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk"/>
Oct 20 14:46:59 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:46:59 user nova-compute[76870]:     </disk>
Oct 20 14:46:59 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:46:59 user nova-compute[76870]:       <mac address="fa:16:3e:d4:a0:4c"/>
Oct 20 14:46:59 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:46:59 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:46:59 user nova-compute[76870]:       <target dev="tapbe363e4d-cc"/>
Oct 20 14:46:59 user nova-compute[76870]:     </interface>
Oct 20 14:46:59 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:46:59 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/console.log" append="off"/>
Oct 20 14:46:59 user nova-compute[76870]:     </serial>
Oct 20 14:46:59 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:46:59 user nova-compute[76870]:     <video>
Oct 20 14:46:59 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:46:59 user nova-compute[76870]:     </video>
Oct 20 14:46:59 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:46:59 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:46:59 user nova-compute[76870]:     </rng>
Oct 20 14:46:59 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:46:59 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:46:59 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:46:59 user nova-compute[76870]:     </memballoon>
Oct 20 14:46:59 user nova-compute[76870]:   </devices>
Oct 20 14:46:59 user nova-compute[76870]: </domain>
Oct 20 14:46:59 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-126319092',display_name='tempest-TestMinimumBasicScenario-server-126319092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-126319092',id=30,image_ref='5aea4786-dcd3-486d-a5bc-d915e6d9a4b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHNEyBbQHpCXb5WVNW47N862wE3gEAbINjYbQh728tUs4LASgdToY9W99CeyK6TDi9fachCRN8XbtUcA64EoX6c/1t5JUF0aDfvdCDKbnQvpWIHoAXX7WbzuwtmvRWdw==',key_name='tempest-TestMinimumBasicScenario-687725015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0587d1c60494c99b9925d303898f203',ramdisk_id='',reservation_id='r-rht75m7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5aea4786-dcd3-486d-a5bc-d915e6d9a4b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1438762037',owner_user_name='tempest-TestMinimumBasicScenario-1438762037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:46:57Z,user_data=None,user_id='9ce9bea46975483190038bf47a226ced',uuid=a16a3e38-cf87-4bb7-a0eb-e2e9537df659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converting VIF {"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG os_vif [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2739fd1e-b8b0-5b70-af68-cb0f9ef74f5a', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe363e4d-cc, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe363e4d-cc, col_values=(('qos', UUID('d36389a5-69ad-4915-9bd1-1d8c12ef4c9a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe363e4d-cc, col_values=(('external_ids', {'iface-id': 'be363e4d-cc33-48a2-8f24-53e40c95f20d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:a0:4c', 'vm-uuid': 'a16a3e38-cf87-4bb7-a0eb-e2e9537df659'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:46:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:46:59 user nova-compute[76870]: INFO os_vif [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc')
Oct 20 14:47:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:47:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No VIF found with MAC fa:16:3e:d4:a0:4c, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:47:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updated VIF entry in instance network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:47:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-16ba7a3c-075e-4ebc-b489-2bf11ff83d69 req-cc5aaf3b-21ef-4b0b-86d3-6cece5bd5a6a service nova] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-5e152682-9fb8-408f-a6ca-15104fa41a6f req-2b8feb6b-aa60-403a-bc3f-43b55e58106a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e152682-9fb8-408f-a6ca-15104fa41a6f req-2b8feb6b-aa60-403a-bc3f-43b55e58106a service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e152682-9fb8-408f-a6ca-15104fa41a6f req-2b8feb6b-aa60-403a-bc3f-43b55e58106a service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e152682-9fb8-408f-a6ca-15104fa41a6f req-2b8feb6b-aa60-403a-bc3f-43b55e58106a service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-5e152682-9fb8-408f-a6ca-15104fa41a6f req-2b8feb6b-aa60-403a-bc3f-43b55e58106a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:01 user nova-compute[76870]: WARNING nova.compute.manager [req-5e152682-9fb8-408f-a6ca-15104fa41a6f req-2b8feb6b-aa60-403a-bc3f-43b55e58106a service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state building and task_state spawning.
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing instance network info cache due to event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:47:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:47:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:47:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updated VIF entry in instance network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-758d7802-5e2a-4c76-82a4-f96bd3dfa3ce req-b793a250-0bfd-4866-ad52-7d62472c6439 service nova] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:47:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance spawned successfully.
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d4357af-54f3-459d-beaf-398d74b77ae4 req-bdacb081-4602-4dc7-a987-d687735154b1 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d4357af-54f3-459d-beaf-398d74b77ae4 req-bdacb081-4602-4dc7-a987-d687735154b1 service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d4357af-54f3-459d-beaf-398d74b77ae4 req-bdacb081-4602-4dc7-a987-d687735154b1 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d4357af-54f3-459d-beaf-398d74b77ae4 req-bdacb081-4602-4dc7-a987-d687735154b1 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d4357af-54f3-459d-beaf-398d74b77ae4 req-bdacb081-4602-4dc7-a987-d687735154b1 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:03 user nova-compute[76870]: WARNING nova.compute.manager [req-0d4357af-54f3-459d-beaf-398d74b77ae4 req-bdacb081-4602-4dc7-a987-d687735154b1 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state building and task_state spawning.
Oct 20 14:47:03 user nova-compute[76870]: INFO nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:47:03 user nova-compute[76870]: INFO nova.compute.manager [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Took 6.79 seconds to build instance.
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7706300-02e5-4d58-aa66-db1708570c9d tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.886s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:47:04 user nova-compute[76870]: INFO nova.compute.claims [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Claim successful on node user
Oct 20 14:47:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:47:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:04 user nova-compute[76870]: DEBUG nova.policy [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '859e78a4758a4cafa8e547e12126b1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99999331a734dc0b3cc9fcc517dfc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:47:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Creating image(s)
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "/opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "/opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "/opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk 1073741824" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Successfully created port: c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.214s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Cannot resize image /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Ensure instance console log exists: /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Successfully updated port: c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquired lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-changed-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Refreshing instance network info cache due to event network-changed-c56028f8-c4e0-44a2-934c-42c403eca5c5. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] Acquiring lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updating instance_info_cache with network_info: [{"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Releasing lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Instance network_info: |[{"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] Acquired lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Refreshing network info cache for port c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Start _get_guest_xml network_info=[{"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:47:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:47:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:47:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-821477869',display_name='tempest-AttachVolumeTestJSON-server-821477869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-821477869',id=31,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUCiTdtPTQZUiVvjBJvMi9UjOxSYrbnhhYCEHxWQYmK6llOOFsZ29niCKTspustbgg3TgnEJSCQhWKRQBcCRA5Uj5AfD/XiBc06I3uHJ6ktiRa4Tt6G5GGlVrUHG1VRcw==',key_name='tempest-keypair-1950891247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-llf3i1fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=29576bee-2c13-41f3-829f-09b61067efdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'pci_devices' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:47:06 user nova-compute[76870]:   <uuid>29576bee-2c13-41f3-829f-09b61067efdc</uuid>
Oct 20 14:47:06 user nova-compute[76870]:   <name>instance-0000001f</name>
Oct 20 14:47:06 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:47:06 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:47:06 user nova-compute[76870]:   <metadata>
Oct 20 14:47:06 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:47:06 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:47:06 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeTestJSON-server-821477869</nova:name>
Oct 20 14:47:06 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:47:06</nova:creationTime>
Oct 20 14:47:06 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:47:06 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:47:06 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:47:06 user nova-compute[76870]:       <nova:owner>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:user uuid="859e78a4758a4cafa8e547e12126b1e4">tempest-AttachVolumeTestJSON-345124704-project-member</nova:user>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:project uuid="d99999331a734dc0b3cc9fcc517dfc9a">tempest-AttachVolumeTestJSON-345124704</nova:project>
Oct 20 14:47:06 user nova-compute[76870]:       </nova:owner>
Oct 20 14:47:06 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:47:06 user nova-compute[76870]:       <nova:ports>
Oct 20 14:47:06 user nova-compute[76870]:         <nova:port uuid="c56028f8-c4e0-44a2-934c-42c403eca5c5">
Oct 20 14:47:06 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 14:47:06 user nova-compute[76870]:         </nova:port>
Oct 20 14:47:06 user nova-compute[76870]:       </nova:ports>
Oct 20 14:47:06 user nova-compute[76870]:     </nova:instance>
Oct 20 14:47:06 user nova-compute[76870]:   </metadata>
Oct 20 14:47:06 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:47:06 user nova-compute[76870]:     <system>
Oct 20 14:47:06 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:47:06 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:47:06 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:47:06 user nova-compute[76870]:       <entry name="serial">29576bee-2c13-41f3-829f-09b61067efdc</entry>
Oct 20 14:47:06 user nova-compute[76870]:       <entry name="uuid">29576bee-2c13-41f3-829f-09b61067efdc</entry>
Oct 20 14:47:06 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:47:06 user nova-compute[76870]:     </system>
Oct 20 14:47:06 user nova-compute[76870]:   </sysinfo>
Oct 20 14:47:06 user nova-compute[76870]:   <os>
Oct 20 14:47:06 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:47:06 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:47:06 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:47:06 user nova-compute[76870]:   </os>
Oct 20 14:47:06 user nova-compute[76870]:   <features>
Oct 20 14:47:06 user nova-compute[76870]:     <acpi/>
Oct 20 14:47:06 user nova-compute[76870]:     <apic/>
Oct 20 14:47:06 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:47:06 user nova-compute[76870]:   </features>
Oct 20 14:47:06 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:47:06 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:47:06 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:47:06 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:47:06 user nova-compute[76870]:   </clock>
Oct 20 14:47:06 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:47:06 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:47:06 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:47:06 user nova-compute[76870]:   </cpu>
Oct 20 14:47:06 user nova-compute[76870]:   <devices>
Oct 20 14:47:06 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:47:06 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:47:06 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk"/>
Oct 20 14:47:06 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:47:06 user nova-compute[76870]:     </disk>
Oct 20 14:47:06 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:47:06 user nova-compute[76870]:       <mac address="fa:16:3e:49:c7:2f"/>
Oct 20 14:47:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:47:06 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:47:06 user nova-compute[76870]:       <target dev="tapc56028f8-c4"/>
Oct 20 14:47:06 user nova-compute[76870]:     </interface>
Oct 20 14:47:06 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:47:06 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/console.log" append="off"/>
Oct 20 14:47:06 user nova-compute[76870]:     </serial>
Oct 20 14:47:06 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:47:06 user nova-compute[76870]:     <video>
Oct 20 14:47:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:47:06 user nova-compute[76870]:     </video>
Oct 20 14:47:06 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:47:06 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:47:06 user nova-compute[76870]:     </rng>
Oct 20 14:47:06 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:47:06 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:47:06 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:47:06 user nova-compute[76870]:     </memballoon>
Oct 20 14:47:06 user nova-compute[76870]:   </devices>
Oct 20 14:47:06 user nova-compute[76870]: </domain>
Oct 20 14:47:06 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:47:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-821477869',display_name='tempest-AttachVolumeTestJSON-server-821477869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-821477869',id=31,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUCiTdtPTQZUiVvjBJvMi9UjOxSYrbnhhYCEHxWQYmK6llOOFsZ29niCKTspustbgg3TgnEJSCQhWKRQBcCRA5Uj5AfD/XiBc06I3uHJ6ktiRa4Tt6G5GGlVrUHG1VRcw==',key_name='tempest-keypair-1950891247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-llf3i1fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=29576bee-2c13-41f3-829f-09b61067efdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG os_vif [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '911b5fdc-cc6a-50fa-9d1a-31ca839a579b', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc56028f8-c4, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc56028f8-c4, col_values=(('qos', UUID('bcda59c1-8dd3-4d79-b9bb-0289fb56c910')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc56028f8-c4, col_values=(('external_ids', {'iface-id': 'c56028f8-c4e0-44a2-934c-42c403eca5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:c7:2f', 'vm-uuid': '29576bee-2c13-41f3-829f-09b61067efdc'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:06 user nova-compute[76870]: INFO os_vif [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4')
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:47:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No VIF found with MAC fa:16:3e:49:c7:2f, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:47:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updated VIF entry in instance network info cache for port c56028f8-c4e0-44a2-934c-42c403eca5c5. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:47:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updating instance_info_cache with network_info: [{"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-08279265-af7e-4226-b7b2-18cb8067a672 req-92cb7d48-b800-42b2-8b0c-e63fd54238cc service nova] Releasing lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-71c3382a-d1a8-4461-9f6d-8f5ff4b24288 req-aad67113-7027-47fe-9926-417719a28714 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71c3382a-d1a8-4461-9f6d-8f5ff4b24288 req-aad67113-7027-47fe-9926-417719a28714 service nova] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71c3382a-d1a8-4461-9f6d-8f5ff4b24288 req-aad67113-7027-47fe-9926-417719a28714 service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71c3382a-d1a8-4461-9f6d-8f5ff4b24288 req-aad67113-7027-47fe-9926-417719a28714 service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-71c3382a-d1a8-4461-9f6d-8f5ff4b24288 req-aad67113-7027-47fe-9926-417719a28714 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] No waiting events found dispatching network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:08 user nova-compute[76870]: WARNING nova.compute.manager [req-71c3382a-d1a8-4461-9f6d-8f5ff4b24288 req-aad67113-7027-47fe-9926-417719a28714 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received unexpected event network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 for instance with vm_state building and task_state spawning.
Oct 20 14:47:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:09 user nova-compute[76870]: INFO nova.compute.manager [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Shelving
Oct 20 14:47:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-948a709e-3744-462e-86b3-f5319460a61d req-99ce8bbb-9b29-49a0-aa8d-a5a487dccc3d service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-unplugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-948a709e-3744-462e-86b3-f5319460a61d req-99ce8bbb-9b29-49a0-aa8d-a5a487dccc3d service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-948a709e-3744-462e-86b3-f5319460a61d req-99ce8bbb-9b29-49a0-aa8d-a5a487dccc3d service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-948a709e-3744-462e-86b3-f5319460a61d req-99ce8bbb-9b29-49a0-aa8d-a5a487dccc3d service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-948a709e-3744-462e-86b3-f5319460a61d req-99ce8bbb-9b29-49a0-aa8d-a5a487dccc3d service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-unplugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:09 user nova-compute[76870]: WARNING nova.compute.manager [req-948a709e-3744-462e-86b3-f5319460a61d req-99ce8bbb-9b29-49a0-aa8d-a5a487dccc3d service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-unplugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state active and task_state shelving.
Oct 20 14:47:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance destroyed successfully.
Oct 20 14:47:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Beginning cold snapshot process
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:47:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Instance spawned successfully.
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk /opt/stack/data/nova/instances/snapshots/tmpg93zd0n6/0c6e541c23e64f108ba710a942e5bced {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:10 user nova-compute[76870]: INFO nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-b4de465e-8ffb-4497-a586-edfde8a0184d req-c34a28f3-3e32-4ace-98dc-33733350545e service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b4de465e-8ffb-4497-a586-edfde8a0184d req-c34a28f3-3e32-4ace-98dc-33733350545e service nova] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b4de465e-8ffb-4497-a586-edfde8a0184d req-c34a28f3-3e32-4ace-98dc-33733350545e service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b4de465e-8ffb-4497-a586-edfde8a0184d req-c34a28f3-3e32-4ace-98dc-33733350545e service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:10 user nova-compute[76870]: DEBUG nova.compute.manager [req-b4de465e-8ffb-4497-a586-edfde8a0184d req-c34a28f3-3e32-4ace-98dc-33733350545e service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] No waiting events found dispatching network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:10 user nova-compute[76870]: WARNING nova.compute.manager [req-b4de465e-8ffb-4497-a586-edfde8a0184d req-c34a28f3-3e32-4ace-98dc-33733350545e service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received unexpected event network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 for instance with vm_state building and task_state spawning.
Oct 20 14:47:10 user nova-compute[76870]: INFO nova.compute.manager [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Took 6.80 seconds to build instance.
Oct 20 14:47:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9ae0ee1a-ced3-4391-85dc-e6a45f2a4ed9 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.909s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk /opt/stack/data/nova/instances/snapshots/tmpg93zd0n6/0c6e541c23e64f108ba710a942e5bced" returned: 0 in 0.721s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Snapshot extracted, beginning image upload
Oct 20 14:47:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-14b9861a-5eb1-4447-881d-3930caa0f5df req-734362b1-4b1e-4ee3-ad4a-4d85d9e792e5 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14b9861a-5eb1-4447-881d-3930caa0f5df req-734362b1-4b1e-4ee3-ad4a-4d85d9e792e5 service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14b9861a-5eb1-4447-881d-3930caa0f5df req-734362b1-4b1e-4ee3-ad4a-4d85d9e792e5 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14b9861a-5eb1-4447-881d-3930caa0f5df req-734362b1-4b1e-4ee3-ad4a-4d85d9e792e5 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-14b9861a-5eb1-4447-881d-3930caa0f5df req-734362b1-4b1e-4ee3-ad4a-4d85d9e792e5 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:11 user nova-compute[76870]: WARNING nova.compute.manager [req-14b9861a-5eb1-4447-881d-3930caa0f5df req-734362b1-4b1e-4ee3-ad4a-4d85d9e792e5 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 14:47:14 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Snapshot image upload complete
Oct 20 14:47:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:47:14 user nova-compute[76870]: INFO nova.compute.manager [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Shelve offloading
Oct 20 14:47:14 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance destroyed successfully.
Oct 20 14:47:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:47:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:47:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:47:14 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:47:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:14 user nova-compute[76870]: DEBUG nova.network.neutron [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance destroyed successfully.
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.objects.instance [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'resources' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1814354559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1814354559',id=25,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTwq03L6/YGp9fIcRcBxmdb6Nkd/LyCwM55OTvK37ZjHDgm5CaHvrje1k5DI246VE7gcKlIFOq1pkOCeKOk1vCTHe/ifeVCz9kdUstA2TIsXkIPTX3Je6oaqaWEt1GNw==',key_name='tempest-keypair-454063210',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-s75dwr07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member',shelved_at='2023-10-20T14:47:14.201357',shelved_host='user',shelved_image_id='212962fd-e5fe-4bcb-9700-85f5289c1f42'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=4e56958e-edf4-4912-ac47-1ce9da96145f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG os_vif [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap137fb91e-86, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8682d008-5755-4c18-b77c-d6f3ad3da7fc) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing instance network info cache due to event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.network.neutron [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:47:15 user nova-compute[76870]: INFO os_vif [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86')
Oct 20 14:47:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Deleting instance files /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f_del
Oct 20 14:47:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Deletion of /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f_del complete
Oct 20 14:47:15 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Deleted allocations for instance 4e56958e-edf4-4912-ac47-1ce9da96145f
Oct 20 14:47:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.objects.instance [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.objects.base [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<4e56958e-edf4-4912-ac47-1ce9da96145f> lazy-loaded attributes: resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.network.neutron [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updated VIF entry in instance network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.network.neutron [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap137fb91e-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-21d9175e-17cf-48e0-bb53-f6c1b2d8bff9 req-23ab148f-171e-4359-910c-de60dc9cad92 service nova] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:47:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1d71ad30-8c91-452e-af5c-75c8b4bd8bc9 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.431s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:16 user nova-compute[76870]: INFO nova.compute.manager [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Terminating instance
Oct 20 14:47:16 user nova-compute[76870]: DEBUG nova.compute.manager [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-0ebd482f-b4b1-424e-8116-21a74872b9f4 req-23be33cd-49d3-4ddf-beea-5040b168bf24 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-unplugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0ebd482f-b4b1-424e-8116-21a74872b9f4 req-23be33cd-49d3-4ddf-beea-5040b168bf24 service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0ebd482f-b4b1-424e-8116-21a74872b9f4 req-23be33cd-49d3-4ddf-beea-5040b168bf24 service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0ebd482f-b4b1-424e-8116-21a74872b9f4 req-23be33cd-49d3-4ddf-beea-5040b168bf24 service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-0ebd482f-b4b1-424e-8116-21a74872b9f4 req-23be33cd-49d3-4ddf-beea-5040b168bf24 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-unplugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-0ebd482f-b4b1-424e-8116-21a74872b9f4 req-23be33cd-49d3-4ddf-beea-5040b168bf24 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-unplugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Instance destroyed successfully.
Oct 20 14:47:17 user nova-compute[76870]: DEBUG nova.objects.instance [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lazy-loading 'resources' on Instance uuid 7f7f0d77-948f-4c3c-8308-1d8c531c6bff {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-904147619',display_name='tempest-VolumesActionsTest-instance-904147619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-904147619',id=26,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='705d22169e9d4c33beaba01971d0e10d',ramdisk_id='',reservation_id='r-3phlvnhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1366356536',owner_user_name='tempest-VolumesActionsTest-1366356536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:45:32Z,user_data=None,user_id='41ffa7bfd51042efb29a472a9aabfbf1',uuid=7f7f0d77-948f-4c3c-8308-1d8c531c6bff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converting VIF {"id": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "address": "fa:16:3e:3f:c4:57", "network": {"id": "eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-334109168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "705d22169e9d4c33beaba01971d0e10d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a22331f-1c", "ovs_interfaceid": "2a22331f-1c5d-4533-a3ce-f9813a1fda55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG os_vif [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a22331f-1c, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb6da7b1-3827-4a45-acb7-417d43af248d) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: INFO os_vif [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:c4:57,bridge_name='br-int',has_traffic_filtering=True,id=2a22331f-1c5d-4533-a3ce-f9813a1fda55,network=Network(eaa16a36-cc1f-4abd-b9d7-679d8fabdf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a22331f-1c')
Oct 20 14:47:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Deleting instance files /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff_del
Oct 20 14:47:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Deletion of /opt/stack/data/nova/instances/7f7f0d77-948f-4c3c-8308-1d8c531c6bff_del complete
Oct 20 14:47:17 user nova-compute[76870]: INFO nova.compute.manager [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 20 14:47:17 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:18 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Took 1.05 seconds to deallocate network for instance.
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-790d938b-3565-45c0-8fc1-012614bba5cf req-c14513c9-789a-4549-acfe-6d9807e385d8 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-deleted-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:18 user nova-compute[76870]: INFO nova.compute.manager [req-790d938b-3565-45c0-8fc1-012614bba5cf req-c14513c9-789a-4549-acfe-6d9807e385d8 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Neutron deleted interface 2a22331f-1c5d-4533-a3ce-f9813a1fda55; detaching it from the instance and deleting it from the info cache
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-790d938b-3565-45c0-8fc1-012614bba5cf req-c14513c9-789a-4549-acfe-6d9807e385d8 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-790d938b-3565-45c0-8fc1-012614bba5cf req-c14513c9-789a-4549-acfe-6d9807e385d8 service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Detach interface failed, port_id=2a22331f-1c5d-4533-a3ce-f9813a1fda55, reason: Instance 7f7f0d77-948f-4c3c-8308-1d8c531c6bff could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:18 user nova-compute[76870]: WARNING nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state deleted and task_state None.
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:18 user nova-compute[76870]: WARNING nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state deleted and task_state None.
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:18 user nova-compute[76870]: WARNING nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state deleted and task_state None.
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-unplugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-unplugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:18 user nova-compute[76870]: WARNING nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-unplugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state deleted and task_state None.
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Acquiring lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] No waiting events found dispatching network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:18 user nova-compute[76870]: WARNING nova.compute.manager [req-195faf60-d1af-456b-8e25-8b25aec6622c req-03de28de-334f-4434-99f5-42e8bbfae77f service nova] [instance: 7f7f0d77-948f-4c3c-8308-1d8c531c6bff] Received unexpected event network-vif-plugged-2a22331f-1c5d-4533-a3ce-f9813a1fda55 for instance with vm_state deleted and task_state None.
Oct 20 14:47:18 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:18 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Deleted allocations for instance 7f7f0d77-948f-4c3c-8308-1d8c531c6bff
Oct 20 14:47:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-87518728-0303-4b9c-b422-71f8ff2f61ab tempest-VolumesActionsTest-1366356536 tempest-VolumesActionsTest-1366356536-project-member] Lock "7f7f0d77-948f-4c3c-8308-1d8c531c6bff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:27 user nova-compute[76870]: INFO nova.compute.manager [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Terminating instance
Oct 20 14:47:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:47:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f56b661-de20-46a8-9328-d8d457f9a36a req-bf384b1a-91d5-4ba7-8cee-3c120e88f489 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-unplugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8f56b661-de20-46a8-9328-d8d457f9a36a req-bf384b1a-91d5-4ba7-8cee-3c120e88f489 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8f56b661-de20-46a8-9328-d8d457f9a36a req-bf384b1a-91d5-4ba7-8cee-3c120e88f489 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8f56b661-de20-46a8-9328-d8d457f9a36a req-bf384b1a-91d5-4ba7-8cee-3c120e88f489 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f56b661-de20-46a8-9328-d8d457f9a36a req-bf384b1a-91d5-4ba7-8cee-3c120e88f489 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-unplugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f56b661-de20-46a8-9328-d8d457f9a36a req-bf384b1a-91d5-4ba7-8cee-3c120e88f489 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-unplugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Instance destroyed successfully.
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'resources' on Instance uuid 7399dd8d-e135-45f3-b414-55111ec046aa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1136714047',display_name='tempest-AttachVolumeNegativeTest-server-1136714047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1136714047',id=24,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe2cEER4qZoRMNiFyskGT5ooLhTBdROMnH0wk8T5e+qXQrxZBsHkrb28L/9t9FHfkEGLBO7/gOfPQjCHTi73xYTwznK89sqKaD7Hvh9YuJN0OnlaE41iTeGt4FLPviWhg==',key_name='tempest-keypair-1615230115',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-04twbcx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=7399dd8d-e135-45f3-b414-55111ec046aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "address": "fa:16:3e:c0:94:54", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc9ee47-3e", "ovs_interfaceid": "8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG os_vif [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bc9ee47-3e, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b03c928-74f5-4f47-8aef-4e07326fbe99) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:28 user nova-compute[76870]: INFO os_vif [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:94:54,bridge_name='br-int',has_traffic_filtering=True,id=8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc9ee47-3e')
Oct 20 14:47:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Deleting instance files /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa_del
Oct 20 14:47:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Deletion of /opt/stack/data/nova/instances/7399dd8d-e135-45f3-b414-55111ec046aa_del complete
Oct 20 14:47:28 user nova-compute[76870]: INFO nova.compute.manager [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 20 14:47:28 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:47:28 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:47:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:30 user nova-compute[76870]: WARNING nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received unexpected event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with vm_state active and task_state deleting.
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:30 user nova-compute[76870]: WARNING nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received unexpected event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with vm_state active and task_state deleting.
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:30 user nova-compute[76870]: WARNING nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received unexpected event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with vm_state active and task_state deleting.
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-unplugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-unplugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-unplugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Acquiring lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] Lock "7399dd8d-e135-45f3-b414-55111ec046aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] No waiting events found dispatching network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:30 user nova-compute[76870]: WARNING nova.compute.manager [req-5926ab9d-056e-47a3-b3ed-73c83c0abd84 req-32e4d28b-8d63-4387-b720-4b0050e1be62 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received unexpected event network-vif-plugged-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 for instance with vm_state active and task_state deleting.
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:30 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Took 1.31 seconds to deallocate network for instance.
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:30 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Deleted allocations for instance 7399dd8d-e135-45f3-b414-55111ec046aa
Oct 20 14:47:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fecb760d-2926-43fa-9ca1-869b478d0c39 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "7399dd8d-e135-45f3-b414-55111ec046aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.847s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-9c362aad-1412-466f-a011-7eb15ed35a38 req-98064f3c-3ad7-4542-b3ef-1bcb988f8081 service nova] [instance: 7399dd8d-e135-45f3-b414-55111ec046aa] Received event network-vif-deleted-8bc9ee47-3ee8-4f5c-a1c5-dbfeb892d591 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:47:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:39 user nova-compute[76870]: INFO nova.compute.manager [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Rescuing
Oct 20 14:47:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:47:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:47:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:47:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:47:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-6a31845e-1117-40ed-8a75-9257486861ab req-31a0802f-57a5-4873-8e7f-453e222cafe0 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6a31845e-1117-40ed-8a75-9257486861ab req-31a0802f-57a5-4873-8e7f-453e222cafe0 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6a31845e-1117-40ed-8a75-9257486861ab req-31a0802f-57a5-4873-8e7f-453e222cafe0 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6a31845e-1117-40ed-8a75-9257486861ab req-31a0802f-57a5-4873-8e7f-453e222cafe0 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-6a31845e-1117-40ed-8a75-9257486861ab req-31a0802f-57a5-4873-8e7f-453e222cafe0 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:40 user nova-compute[76870]: WARNING nova.compute.manager [req-6a31845e-1117-40ed-8a75-9257486861ab req-31a0802f-57a5-4873-8e7f-453e222cafe0 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance destroyed successfully.
Oct 20 14:47:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Attempting rescue
Oct 20 14:47:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 14:47:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Creating image(s)
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.212s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.408s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'migration_context' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.base [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<85c1fb0e-ae51-453e-9bbc-7f86370d44d4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Start _get_guest_xml network_info=[{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:7f:28:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'resources' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.base [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<85c1fb0e-ae51-453e-9bbc-7f86370d44d4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'numa_topology' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.base [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<85c1fb0e-ae51-453e-9bbc-7f86370d44d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:47:41 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:47:41 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.base [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<85c1fb0e-ae51-453e-9bbc-7f86370d44d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397882495',display_name='tempest-ServerRescueNegativeTestJSON-server-1397882495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397882495',id=28,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:45:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-cdxtuonh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:56Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=85c1fb0e-ae51-453e-9bbc-7f86370d44d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:7f:28:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:7f:28:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.objects.base [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<85c1fb0e-ae51-453e-9bbc-7f86370d44d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:47:41 user nova-compute[76870]:   <uuid>85c1fb0e-ae51-453e-9bbc-7f86370d44d4</uuid>
Oct 20 14:47:41 user nova-compute[76870]:   <name>instance-0000001c</name>
Oct 20 14:47:41 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:47:41 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:47:41 user nova-compute[76870]:   <metadata>
Oct 20 14:47:41 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:47:41 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:47:41 user nova-compute[76870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1397882495</nova:name>
Oct 20 14:47:41 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:47:41</nova:creationTime>
Oct 20 14:47:41 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:47:41 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:47:41 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:47:41 user nova-compute[76870]:       <nova:owner>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:user uuid="fdd157499df5446e8c082732e1fbd278">tempest-ServerRescueNegativeTestJSON-1475360384-project-member</nova:user>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:project uuid="5bb2d2209f464235949db2d48ec8e2eb">tempest-ServerRescueNegativeTestJSON-1475360384</nova:project>
Oct 20 14:47:41 user nova-compute[76870]:       </nova:owner>
Oct 20 14:47:41 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:47:41 user nova-compute[76870]:       <nova:ports>
Oct 20 14:47:41 user nova-compute[76870]:         <nova:port uuid="49af51a5-d47b-4bb9-842f-105bac22dae3">
Oct 20 14:47:41 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 14:47:41 user nova-compute[76870]:         </nova:port>
Oct 20 14:47:41 user nova-compute[76870]:       </nova:ports>
Oct 20 14:47:41 user nova-compute[76870]:     </nova:instance>
Oct 20 14:47:41 user nova-compute[76870]:   </metadata>
Oct 20 14:47:41 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:47:41 user nova-compute[76870]:     <system>
Oct 20 14:47:41 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:47:41 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:47:41 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:47:41 user nova-compute[76870]:       <entry name="serial">85c1fb0e-ae51-453e-9bbc-7f86370d44d4</entry>
Oct 20 14:47:41 user nova-compute[76870]:       <entry name="uuid">85c1fb0e-ae51-453e-9bbc-7f86370d44d4</entry>
Oct 20 14:47:41 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:47:41 user nova-compute[76870]:     </system>
Oct 20 14:47:41 user nova-compute[76870]:   </sysinfo>
Oct 20 14:47:41 user nova-compute[76870]:   <os>
Oct 20 14:47:41 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:47:41 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:47:41 user nova-compute[76870]:   </os>
Oct 20 14:47:41 user nova-compute[76870]:   <features>
Oct 20 14:47:41 user nova-compute[76870]:     <acpi/>
Oct 20 14:47:41 user nova-compute[76870]:     <apic/>
Oct 20 14:47:41 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:47:41 user nova-compute[76870]:   </features>
Oct 20 14:47:41 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:47:41 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:47:41 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:47:41 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:47:41 user nova-compute[76870]:   </clock>
Oct 20 14:47:41 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:47:41 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:47:41 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:47:41 user nova-compute[76870]:   </cpu>
Oct 20 14:47:41 user nova-compute[76870]:   <devices>
Oct 20 14:47:41 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:47:41 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:47:41 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue"/>
Oct 20 14:47:41 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:47:41 user nova-compute[76870]:     </disk>
Oct 20 14:47:41 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:47:41 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:47:41 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk"/>
Oct 20 14:47:41 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:47:41 user nova-compute[76870]:     </disk>
Oct 20 14:47:41 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:47:41 user nova-compute[76870]:       <mac address="fa:16:3e:7f:28:25"/>
Oct 20 14:47:41 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:47:41 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:47:41 user nova-compute[76870]:       <target dev="tap49af51a5-d4"/>
Oct 20 14:47:41 user nova-compute[76870]:     </interface>
Oct 20 14:47:41 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:47:41 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/console.log" append="off"/>
Oct 20 14:47:41 user nova-compute[76870]:     </serial>
Oct 20 14:47:41 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:47:41 user nova-compute[76870]:     <video>
Oct 20 14:47:41 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:47:41 user nova-compute[76870]:     </video>
Oct 20 14:47:41 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:47:41 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:47:41 user nova-compute[76870]:     </rng>
Oct 20 14:47:41 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:47:41 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:47:41 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:47:41 user nova-compute[76870]:     </memballoon>
Oct 20 14:47:41 user nova-compute[76870]:   </devices>
Oct 20 14:47:41 user nova-compute[76870]: </domain>
Oct 20 14:47:41 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:47:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance destroyed successfully.
Oct 20 14:47:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:7f:28:25, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:41 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:42 user nova-compute[76870]: WARNING nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:42 user nova-compute[76870]: WARNING nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:42 user nova-compute[76870]: WARNING nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:42 user nova-compute[76870]: WARNING nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:42 user nova-compute[76870]: WARNING nova.compute.manager [req-7fcf8746-e8f5-4bd0-813f-ec16663f78d5 req-d4d56001-aa77-49cc-aec5-599049f4bee6 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:44 user nova-compute[76870]: WARNING nova.compute.manager [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:47:44 user nova-compute[76870]: WARNING nova.compute.manager [req-bdf6e34c-2159-4136-a930-13cf47383b82 req-a0af033f-9736-4b7a-8058-733104a29b5e service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state active and task_state rescuing.
Oct 20 14:47:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3de9df45-3e83-4304-a3e9-7e74893239c4 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:47:48 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:47:48 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7803MB free_disk=25.093196868896484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f6030b28-c422-408a-b1b2-5066fd2ea32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 29576bee-2c13-41f3-829f-09b61067efdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:47:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:47:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:47:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:47:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:47:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:47:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:47:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:05 user nova-compute[76870]: INFO nova.compute.manager [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Terminating instance
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-65ced626-54ed-4716-a804-4c6823acaa73 req-84f0f594-c94a-4ef6-a2a3-a114959bc46a service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-vif-unplugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-65ced626-54ed-4716-a804-4c6823acaa73 req-84f0f594-c94a-4ef6-a2a3-a114959bc46a service nova] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-65ced626-54ed-4716-a804-4c6823acaa73 req-84f0f594-c94a-4ef6-a2a3-a114959bc46a service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-65ced626-54ed-4716-a804-4c6823acaa73 req-84f0f594-c94a-4ef6-a2a3-a114959bc46a service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-65ced626-54ed-4716-a804-4c6823acaa73 req-84f0f594-c94a-4ef6-a2a3-a114959bc46a service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] No waiting events found dispatching network-vif-unplugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-65ced626-54ed-4716-a804-4c6823acaa73 req-84f0f594-c94a-4ef6-a2a3-a114959bc46a service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-vif-unplugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:48:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Instance destroyed successfully.
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lazy-loading 'resources' on Instance uuid 2b929936-cca5-4c52-afa4-3c2e9b31284a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-910745528',display_name='tempest-ServersNegativeTestJSON-server-910745528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-910745528',id=18,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba769d3e66645dcabea5000576ab8d5',ramdisk_id='',reservation_id='r-m4mw7mxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2069808',owner_user_name='tempest-ServersNegativeTestJSON-2069808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:39:10Z,user_data=None,user_id='72ae5e79e17d464bbdb1ad94786a845e',uuid=2b929936-cca5-4c52-afa4-3c2e9b31284a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converting VIF {"id": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "address": "fa:16:3e:19:2d:d9", "network": {"id": "1acd8bcb-b116-4510-81a9-345a79fac945", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-979795094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba769d3e66645dcabea5000576ab8d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aba93f8-5b", "ovs_interfaceid": "5aba93f8-5b6b-47af-b19e-a97f0c115637", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG os_vif [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5aba93f8-5b, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1e68b27-e1ea-4ae5-9a86-575f7f14708a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:48:05 user nova-compute[76870]: INFO os_vif [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=5aba93f8-5b6b-47af-b19e-a97f0c115637,network=Network(1acd8bcb-b116-4510-81a9-345a79fac945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aba93f8-5b')
Oct 20 14:48:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Deleting instance files /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a_del
Oct 20 14:48:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Deletion of /opt/stack/data/nova/instances/2b929936-cca5-4c52-afa4-3c2e9b31284a_del complete
Oct 20 14:48:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:06 user nova-compute[76870]: INFO nova.compute.manager [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 14:48:06 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-d76574ed-b17c-43ec-943e-f674e939a2d5 req-91daca3f-f416-4119-9f8d-8b741cbd772c service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-vif-deleted-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:06 user nova-compute[76870]: INFO nova.compute.manager [req-d76574ed-b17c-43ec-943e-f674e939a2d5 req-91daca3f-f416-4119-9f8d-8b741cbd772c service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Neutron deleted interface 5aba93f8-5b6b-47af-b19e-a97f0c115637; detaching it from the instance and deleting it from the info cache
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-d76574ed-b17c-43ec-943e-f674e939a2d5 req-91daca3f-f416-4119-9f8d-8b741cbd772c service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:06 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Took 0.63 seconds to deallocate network for instance.
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-d76574ed-b17c-43ec-943e-f674e939a2d5 req-91daca3f-f416-4119-9f8d-8b741cbd772c service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Detach interface failed, port_id=5aba93f8-5b6b-47af-b19e-a97f0c115637, reason: Instance 2b929936-cca5-4c52-afa4-3c2e9b31284a could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:48:06 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:48:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:07 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Deleted allocations for instance 2b929936-cca5-4c52-afa4-3c2e9b31284a
Oct 20 14:48:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4f620e07-14b0-4a86-abab-8408bfdc4752 tempest-ServersNegativeTestJSON-2069808 tempest-ServersNegativeTestJSON-2069808-project-member] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-96364549-9eb9-494e-bbce-778c6e6e6a00 req-e3548d61-6bf1-4d1a-bde9-5a5440e3996d service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received event network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-96364549-9eb9-494e-bbce-778c6e6e6a00 req-e3548d61-6bf1-4d1a-bde9-5a5440e3996d service nova] Acquiring lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-96364549-9eb9-494e-bbce-778c6e6e6a00 req-e3548d61-6bf1-4d1a-bde9-5a5440e3996d service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-96364549-9eb9-494e-bbce-778c6e6e6a00 req-e3548d61-6bf1-4d1a-bde9-5a5440e3996d service nova] Lock "2b929936-cca5-4c52-afa4-3c2e9b31284a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-96364549-9eb9-494e-bbce-778c6e6e6a00 req-e3548d61-6bf1-4d1a-bde9-5a5440e3996d service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] No waiting events found dispatching network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:48:07 user nova-compute[76870]: WARNING nova.compute.manager [req-96364549-9eb9-494e-bbce-778c6e6e6a00 req-e3548d61-6bf1-4d1a-bde9-5a5440e3996d service nova] [instance: 2b929936-cca5-4c52-afa4-3c2e9b31284a] Received unexpected event network-vif-plugged-5aba93f8-5b6b-47af-b19e-a97f0c115637 for instance with vm_state deleted and task_state None.
Oct 20 14:48:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-changed-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Refreshing instance network info cache due to event network-changed-b6790ddf-f3fd-4d20-b348-1f1881405cde. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:48:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] Acquiring lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:48:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] Acquired lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:48:17 user nova-compute[76870]: DEBUG nova.network.neutron [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Refreshing network info cache for port b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:48:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updated VIF entry in instance network info cache for port b6790ddf-f3fd-4d20-b348-1f1881405cde. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:48:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updating instance_info_cache with network_info: [{"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-989a20c2-37b9-4755-bf07-19a17bbb4abb req-12872422-eef9-449b-b523-0c6c7cc2e778 service nova] Releasing lock "refresh_cache-f6030b28-c422-408a-b1b2-5066fd2ea32f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:48:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:48:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:21 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:48:21 user nova-compute[76870]: INFO nova.compute.claims [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Claim successful on node user
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:48:22 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.policy [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9efb8ffb0f7f47f1ab587820e0f72c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3077015e86bc441e8a6622b6af839537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:48:22 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Creating image(s)
Oct 20 14:48:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "/opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "/opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:22 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.192s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk 1073741824" returned: 0 in 0.050s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Successfully created port: d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Cannot resize image /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Ensure instance console log exists: /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lazy-loading 'flavor' on Instance uuid f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:48:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Successfully updated port: d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquired lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:24 user nova-compute[76870]: INFO nova.compute.manager [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Attaching volume 72c86136-b02d-44af-89ea-b4ac3e50ab1e to /dev/vdb
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-changed-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Refreshing instance network info cache due to event network-changed-d356c304-4b97-4e10-82a5-fd3ba7090d8d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] Acquiring lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_brick.utils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d9b0fc-e84d-43af-ab9c-9232e83e9d15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e962e283-4ef4-4ea7-8988-127c7c4ddd42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9426e49-d079-4b26-bad0-e101366c990e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e8ed8-863f-4654-967a-dbaa388a8f57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:48:24 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efe651-58ab-43fc-8596-eee06d9b359d]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_brick.utils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updating existing volume attachment record: d7fb8477-be08-455c-89d0-446fd6300b4a {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updating instance_info_cache with network_info: [{"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Releasing lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Instance network_info: |[{"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] Acquired lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Refreshing network info cache for port d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Start _get_guest_xml network_info=[{"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:48:24 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:48:24 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2064691044',display_name='tempest-AttachVolumeNegativeTest-server-2064691044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2064691044',id=32,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3odT2gIfHUBl6cSfiKJ/XGl40Fk1RS+zyCq2/AQec9DlwKd593O9p7rRH3wlNJmmL7lJRFbBs/eD6N6gnUAcfJUCnTj6DMiNmZ3Zr9nI/FeF+h07CAH4007GpOalrZog==',key_name='tempest-keypair-906582069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-0askwtw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=495e547d-9819-4017-bf66-0c559c1feb1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.objects.instance [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'pci_devices' on Instance uuid 495e547d-9819-4017-bf66-0c559c1feb1f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:48:24 user nova-compute[76870]:   <uuid>495e547d-9819-4017-bf66-0c559c1feb1f</uuid>
Oct 20 14:48:24 user nova-compute[76870]:   <name>instance-00000020</name>
Oct 20 14:48:24 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:48:24 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:48:24 user nova-compute[76870]:   <metadata>
Oct 20 14:48:24 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:48:24 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:48:24 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2064691044</nova:name>
Oct 20 14:48:24 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:48:24</nova:creationTime>
Oct 20 14:48:24 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:48:24 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:48:24 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:48:24 user nova-compute[76870]:       <nova:owner>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:user uuid="9efb8ffb0f7f47f1ab587820e0f72c91">tempest-AttachVolumeNegativeTest-742706560-project-member</nova:user>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:project uuid="3077015e86bc441e8a6622b6af839537">tempest-AttachVolumeNegativeTest-742706560</nova:project>
Oct 20 14:48:24 user nova-compute[76870]:       </nova:owner>
Oct 20 14:48:24 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:48:24 user nova-compute[76870]:       <nova:ports>
Oct 20 14:48:24 user nova-compute[76870]:         <nova:port uuid="d356c304-4b97-4e10-82a5-fd3ba7090d8d">
Oct 20 14:48:24 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 14:48:24 user nova-compute[76870]:         </nova:port>
Oct 20 14:48:24 user nova-compute[76870]:       </nova:ports>
Oct 20 14:48:24 user nova-compute[76870]:     </nova:instance>
Oct 20 14:48:24 user nova-compute[76870]:   </metadata>
Oct 20 14:48:24 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:48:24 user nova-compute[76870]:     <system>
Oct 20 14:48:24 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:48:24 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:48:24 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:48:24 user nova-compute[76870]:       <entry name="serial">495e547d-9819-4017-bf66-0c559c1feb1f</entry>
Oct 20 14:48:24 user nova-compute[76870]:       <entry name="uuid">495e547d-9819-4017-bf66-0c559c1feb1f</entry>
Oct 20 14:48:24 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:48:24 user nova-compute[76870]:     </system>
Oct 20 14:48:24 user nova-compute[76870]:   </sysinfo>
Oct 20 14:48:24 user nova-compute[76870]:   <os>
Oct 20 14:48:24 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:48:24 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:48:24 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:48:24 user nova-compute[76870]:   </os>
Oct 20 14:48:24 user nova-compute[76870]:   <features>
Oct 20 14:48:24 user nova-compute[76870]:     <acpi/>
Oct 20 14:48:24 user nova-compute[76870]:     <apic/>
Oct 20 14:48:24 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:48:24 user nova-compute[76870]:   </features>
Oct 20 14:48:24 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:48:24 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:48:24 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:48:24 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:48:24 user nova-compute[76870]:   </clock>
Oct 20 14:48:24 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:48:24 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:48:24 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:48:24 user nova-compute[76870]:   </cpu>
Oct 20 14:48:24 user nova-compute[76870]:   <devices>
Oct 20 14:48:24 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:48:24 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:48:24 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk"/>
Oct 20 14:48:24 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:48:24 user nova-compute[76870]:     </disk>
Oct 20 14:48:24 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:48:24 user nova-compute[76870]:       <mac address="fa:16:3e:3d:5c:37"/>
Oct 20 14:48:24 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:48:24 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:48:24 user nova-compute[76870]:       <target dev="tapd356c304-4b"/>
Oct 20 14:48:24 user nova-compute[76870]:     </interface>
Oct 20 14:48:24 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:48:24 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/console.log" append="off"/>
Oct 20 14:48:24 user nova-compute[76870]:     </serial>
Oct 20 14:48:24 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:48:24 user nova-compute[76870]:     <video>
Oct 20 14:48:24 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:48:24 user nova-compute[76870]:     </video>
Oct 20 14:48:24 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:48:24 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:48:24 user nova-compute[76870]:     </rng>
Oct 20 14:48:24 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:48:24 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:48:24 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:48:24 user nova-compute[76870]:     </memballoon>
Oct 20 14:48:24 user nova-compute[76870]:   </devices>
Oct 20 14:48:24 user nova-compute[76870]: </domain>
Oct 20 14:48:24 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2064691044',display_name='tempest-AttachVolumeNegativeTest-server-2064691044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2064691044',id=32,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3odT2gIfHUBl6cSfiKJ/XGl40Fk1RS+zyCq2/AQec9DlwKd593O9p7rRH3wlNJmmL7lJRFbBs/eD6N6gnUAcfJUCnTj6DMiNmZ3Zr9nI/FeF+h07CAH4007GpOalrZog==',key_name='tempest-keypair-906582069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-0askwtw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=495e547d-9819-4017-bf66-0c559c1feb1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG os_vif [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b85f9139-543d-5649-a8e4-5cb376e462bf', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd356c304-4b, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd356c304-4b, col_values=(('qos', UUID('f9e3214c-e09c-4cf2-b8d5-a73bf88e8e54')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd356c304-4b, col_values=(('external_ids', {'iface-id': 'd356c304-4b97-4e10-82a5-fd3ba7090d8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:5c:37', 'vm-uuid': '495e547d-9819-4017-bf66-0c559c1feb1f'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:24 user nova-compute[76870]: INFO os_vif [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b')
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:3d:5c:37, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updated VIF entry in instance network info cache for port d356c304-4b97-4e10-82a5-fd3ba7090d8d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG nova.network.neutron [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updating instance_info_cache with network_info: [{"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-89b38a3e-9de1-4be9-aa1e-c6dbe0d55d6b req-cdb0a68b-b3c3-4d80-a61f-f5e9fb35e851 service nova] Releasing lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG nova.compute.manager [req-519c3c9a-c6d4-4a99-ad17-15d2bf946a0b req-a3d3e743-11c8-42a5-b5a8-30981528352c service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-519c3c9a-c6d4-4a99-ad17-15d2bf946a0b req-a3d3e743-11c8-42a5-b5a8-30981528352c service nova] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-519c3c9a-c6d4-4a99-ad17-15d2bf946a0b req-a3d3e743-11c8-42a5-b5a8-30981528352c service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-519c3c9a-c6d4-4a99-ad17-15d2bf946a0b req-a3d3e743-11c8-42a5-b5a8-30981528352c service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG nova.compute.manager [req-519c3c9a-c6d4-4a99-ad17-15d2bf946a0b req-a3d3e743-11c8-42a5-b5a8-30981528352c service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] No waiting events found dispatching network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:48:26 user nova-compute[76870]: WARNING nova.compute.manager [req-519c3c9a-c6d4-4a99-ad17-15d2bf946a0b req-a3d3e743-11c8-42a5-b5a8-30981528352c service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received unexpected event network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d for instance with vm_state building and task_state spawning.
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:48:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Instance spawned successfully.
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:48:28 user nova-compute[76870]: INFO nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Took 5.56 seconds to spawn the instance on the hypervisor.
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-844cd05b-2e3a-4082-94df-55de47fbe199 req-e2954600-57e2-4097-8975-9de9575586c9 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-844cd05b-2e3a-4082-94df-55de47fbe199 req-e2954600-57e2-4097-8975-9de9575586c9 service nova] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-844cd05b-2e3a-4082-94df-55de47fbe199 req-e2954600-57e2-4097-8975-9de9575586c9 service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-844cd05b-2e3a-4082-94df-55de47fbe199 req-e2954600-57e2-4097-8975-9de9575586c9 service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-844cd05b-2e3a-4082-94df-55de47fbe199 req-e2954600-57e2-4097-8975-9de9575586c9 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] No waiting events found dispatching network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:48:28 user nova-compute[76870]: WARNING nova.compute.manager [req-844cd05b-2e3a-4082-94df-55de47fbe199 req-e2954600-57e2-4097-8975-9de9575586c9 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received unexpected event network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d for instance with vm_state building and task_state spawning.
Oct 20 14:48:28 user nova-compute[76870]: INFO nova.compute.manager [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Took 6.83 seconds to build instance.
Oct 20 14:48:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2030372d-4449-443c-9b22-4878ec730686 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.009s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:48:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWilDNKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:48:42 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:48:42 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:48:42 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aef7a7-2fbc-4c91-8fcb-383da107e697]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:48:42 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced42ca-d466-4f80-8319-0b3ad6b13542]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e] added
Oct 20 14:48:42 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:42 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d10c73-1a37-41d5-9ce2-49a733e1aec8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[de81de4a-4a35-4241-8a4d-bff4c9d60c21]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWilDNKq {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWilDNKq" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f5f11-5778-4350-aedb-2d24b7511ebc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tWilDNKq'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f30571-523e-4c12-a246-bf0c9a36b737]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12053acd-d79c-4530-9dcf-8208c9ac2413]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c97a6-4354-4b81-98f1-8554bbc1e437 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c97a6-4354-4b81-98f1-8554bbc1e437 (non-flash)
Oct 20 14:48:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c97a6-4354-4b81-98f1-8554bbc1e437 (non-flash)
Oct 20 14:48:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607de90-d35f-4d8f-9699-fa6cae0ebf4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260]
Oct 20 14:48:43 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260] successful.
Oct 20 14:48:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6097d4-6d81-4b69-aee0-b0293bb6dcfc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d99a7-79a0-4fea-b57a-4a7226456cc7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c97a6-4354-4b81-98f1-8554bbc1e437 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c97a6-4354-4b81-98f1-8554bbc1e437 (non-flash)
Oct 20 14:48:43 user nova-compute[76870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e (non-flash)
Oct 20 14:48:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7c97a6-4354-4b81-98f1-8554bbc1e437 (non-flash)
Oct 20 14:48:43 user nova-compute[76870]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e (non-flash)
Oct 20 14:48:43 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3eb47f-2b8c-4ad3-bf85-180736e7d901]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWilDNKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:48:43 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23361626236343634', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361626236343634', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lazy-loading 'flavor' on Instance uuid f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:48:44 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:48:44 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:48:44 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:48:44 user nova-compute[76870]:   <serial>72c86136-b02d-44af-89ea-b4ac3e50ab1e</serial>
Oct 20 14:48:44 user nova-compute[76870]: </disk>
Oct 20 14:48:44 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] No VIF found with MAC fa:16:3e:40:cf:a5, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c12a8939-fcde-479a-9b72-1fa0892ac347 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.923s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:48:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:46 user nova-compute[76870]: INFO nova.compute.manager [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Detaching volume 72c86136-b02d-44af-89ea-b4ac3e50ab1e
Oct 20 14:48:46 user nova-compute[76870]: INFO nova.virt.block_device [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Attempting to driver detach volume 72c86136-b02d-44af-89ea-b4ac3e50ab1e from mountpoint /dev/vdb
Oct 20 14:48:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Attempting to detach device vdb from instance f6030b28-c422-408a-b1b2-5066fd2ea32f from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:48:46 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:48:46 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:48:46 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:48:46 user nova-compute[76870]:   <serial>72c86136-b02d-44af-89ea-b4ac3e50ab1e</serial>
Oct 20 14:48:46 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:48:46 user nova-compute[76870]: </disk>
Oct 20 14:48:46 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:48:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Successfully detached device vdb from instance f6030b28-c422-408a-b1b2-5066fd2ea32f from the persistent domain config.
Oct 20 14:48:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6030b28-c422-408a-b1b2-5066fd2ea32f from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:48:46 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:48:46 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:48:46 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:48:46 user nova-compute[76870]:   <serial>72c86136-b02d-44af-89ea-b4ac3e50ab1e</serial>
Oct 20 14:48:46 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:48:46 user nova-compute[76870]: </disk>
Oct 20 14:48:46 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:47 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:48:47 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7790MB free_disk=24.124465942382812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f6030b28-c422-408a-b1b2-5066fd2ea32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 29576bee-2c13-41f3-829f-09b61067efdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 495e547d-9819-4017-bf66-0c559c1feb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:48:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:48:48 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:48:48 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:48:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:48:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:48:50 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:48:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:48:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:48:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'flavor' on Instance uuid a16a3e38-cf87-4bb7-a0eb-e2e9537df659 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:48:53 user nova-compute[76870]: INFO nova.compute.manager [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Attaching volume 6c9b3707-f496-4cd2-8396-5aaa35f0e37a to /dev/vdb
Oct 20 14:48:53 user nova-compute[76870]: DEBUG os_brick.utils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b921a-4336-477d-af5d-0bcdc4da4a11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a24218-675b-4f5b-b262-2797ffddca45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e3aac-b0e2-4ebe-a0e0-d086273eb931]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61bbea-694f-4b0d-970c-55abcef24ec7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:48:53 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:48:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27ea1fa-0bb0-49ad-990e-2a4ec0131da1]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG os_brick.utils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:48:53 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating existing volume attachment record: 69802078-6f39-41e5-858a-258547773728 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-changed-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG nova.compute.manager [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Refreshing instance network info cache due to event network-changed-c56028f8-c4e0-44a2-934c-42c403eca5c5. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] Acquiring lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] Acquired lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:48:54 user nova-compute[76870]: DEBUG nova.network.neutron [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Refreshing network info cache for port c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:48:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updated VIF entry in instance network info cache for port c56028f8-c4e0-44a2-934c-42c403eca5c5. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:48:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updating instance_info_cache with network_info: [{"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:48:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c461aa8e-d40e-4096-bc31-4da342249359 req-619f1729-9cc7-4939-9852-af26ee978742 service nova] Releasing lock "refresh_cache-29576bee-2c13-41f3-829f-09b61067efdc" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:48:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:48:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:00 user nova-compute[76870]: DEBUG nova.objects.instance [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:01 user nova-compute[76870]: INFO nova.compute.manager [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attaching volume 853765a3-86d8-437a-ab81-213751dc7ec4 to /dev/vdb
Oct 20 14:49:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cee101-2561-4def-89b3-ec9ddcc3028a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[83264b04-a18d-4005-8e3e-403dbf533cfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ea1f9-97ea-42f5-b122-45997c51a725]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3918d30-85ff-4c36-8fb4-e17921fa4572]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:49:01 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:49:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8a0ac-97dc-4624-9b03-36b4660fcbc7]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG os_brick.utils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:49:01 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updating existing volume attachment record: 61da431b-48b0-4463-9081-74a973ebe8b4 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:49:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:02 user nova-compute[76870]: INFO nova.compute.manager [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Unshelving
Oct 20 14:49:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:03 user nova-compute[76870]: DEBUG nova.objects.instance [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'pci_requests' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:03 user nova-compute[76870]: DEBUG nova.objects.instance [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:49:03 user nova-compute[76870]: INFO nova.compute.claims [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Claim successful on node user
Oct 20 14:49:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:49:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:49:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:03 user nova-compute[76870]: INFO nova.network.neutron [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating port 137fb91e-867b-4702-8cd1-dcfdf81a25a7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing instance network info cache due to event network-changed-137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] Acquiring lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:49:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:49:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Creating image(s)
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] Acquired lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG nova.network.neutron [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Refreshing network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG nova.objects.base [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<4e56958e-edf4-4912-ac47-1ce9da96145f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "8ca613031cfb482bdb71001e03d67d4c11ea21d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "8ca613031cfb482bdb71001e03d67d4c11ea21d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updated VIF entry in instance network info cache for port 137fb91e-867b-4702-8cd1-dcfdf81a25a7. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-211c076f-5c70-4117-b0b3-cf6aff173823 req-136ff950-ee68-4fa9-b995-9777e3299db4 service nova] Releasing lock "refresh_cache-4e56958e-edf4-4912-ac47-1ce9da96145f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.part --force-share --output=json" returned: 0 in 0.213s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG nova.virt.images [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] 212962fd-e5fe-4bcb-9700-85f5289c1f42 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.part /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6030b28-c422-408a-b1b2-5066fd2ea32f is timed out.
Oct 20 14:49:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Successfully detached device vdb from instance f6030b28-c422-408a-b1b2-5066fd2ea32f from the live domain config.
Oct 20 14:49:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:49:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWilDNKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:49:06 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2017d4a-7076-4aa0-8faa-b5935da09b2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:49:07 user nova-compute[76870]: No targets found.
Oct 20 14:49:07 user nova-compute[76870]: iSNS:
Oct 20 14:49:07 user nova-compute[76870]: No targets found.
Oct 20 14:49:07 user nova-compute[76870]: STATIC:
Oct 20 14:49:07 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e
Oct 20 14:49:07 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:49:07 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:49:07 user nova-compute[76870]: FIRMWARE:
Oct 20 14:49:07 user nova-compute[76870]: No targets found.
Oct 20 14:49:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:49:07 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:49:07 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b920e9-d3a3-485f-81ff-79f07b17ce0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5341545e-f512-4506-ac67-8f1f3699d4cb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e (non-flash)
Oct 20 14:49:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e (non-flash)
Oct 20 14:49:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf84cf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39773c17-b46e-470e-9722-724a0cdd2a4e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[78152ba5-5561-40e7-bd26-37a57164c5a7]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f2416-78f4-43ab-9520-8962e2ca78a0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.104s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99779dc-3968-4ee6-890f-d977b85bb270]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee946f7d-56d1-4615-8693-f1aad7651625]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b6af3b-57b0-423a-bd66-a23876b60728]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260]
Oct 20 14:49:07 user nova-compute[76870]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e, portal: 172.16.0.220,3260] successful.
Oct 20 14:49:07 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72c86136-b02d-44af-89ea-b4ac3e50ab1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca75e02-962f-497e-a594-b64955915a50]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.534s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] <== disconnect_volume: return (536ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.part /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.converted" returned: 0 in 0.889s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "8ca613031cfb482bdb71001e03d67d4c11ea21d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.837s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "8ca613031cfb482bdb71001e03d67d4c11ea21d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "8ca613031cfb482bdb71001e03d67d4c11ea21d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 --force-share --output=json" returned: 0 in 0.227s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6,backing_fmt=raw /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6,backing_fmt=raw /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk 1073741824" returned: 0 in 0.060s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "8ca613031cfb482bdb71001e03d67d4c11ea21d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG nova.objects.instance [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lazy-loading 'flavor' on Instance uuid f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fbc26430-6850-4f75-aef0-2ef4910cecba tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.171s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG nova.objects.instance [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'migration_context' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG nova.objects.base [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<4e56958e-edf4-4912-ac47-1ce9da96145f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:49:08 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Rebasing disk image.
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 -F raw /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 -F raw /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk" returned: 0 in 2.655s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Ensure instance console log exists: /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Start _get_guest_xml network_info=[{"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='78e783d40faf6fadeb6e04214f488b42',container_format='bare',created_at=2023-10-20T14:47:10Z,direct_url=<?>,disk_format='qcow2',id=212962fd-e5fe-4bcb-9700-85f5289c1f42,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1814354559-shelved',owner='b3670195fbec411c891e3ea8820b01d1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T14:47:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:49:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:49:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='78e783d40faf6fadeb6e04214f488b42',container_format='bare',created_at=2023-10-20T14:47:10Z,direct_url=<?>,disk_format='qcow2',id=212962fd-e5fe-4bcb-9700-85f5289c1f42,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1814354559-shelved',owner='b3670195fbec411c891e3ea8820b01d1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T14:47:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.objects.instance [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.objects.base [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<4e56958e-edf4-4912-ac47-1ce9da96145f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1814354559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1814354559',id=25,image_ref='212962fd-e5fe-4bcb-9700-85f5289c1f42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-454063210',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-s75dwr07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member',shelved_at='2023-10-20T14:47:14.201357',shelved_host='user',shelved_image_id='212962fd-e5fe-4bcb-9700-85f5289c1f42'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=4e56958e-edf4-4912-ac47-1ce9da96145f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.objects.instance [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.objects.base [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Object Instance<4e56958e-edf4-4912-ac47-1ce9da96145f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:49:11 user nova-compute[76870]:   <uuid>4e56958e-edf4-4912-ac47-1ce9da96145f</uuid>
Oct 20 14:49:11 user nova-compute[76870]:   <name>instance-00000019</name>
Oct 20 14:49:11 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:49:11 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:49:11 user nova-compute[76870]:   <metadata>
Oct 20 14:49:11 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:49:11 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:49:11 user nova-compute[76870]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1814354559</nova:name>
Oct 20 14:49:11 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:49:11</nova:creationTime>
Oct 20 14:49:11 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:49:11 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:49:11 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:49:11 user nova-compute[76870]:       <nova:owner>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:user uuid="a358910175f646c39bb6d7e12ed5334e">tempest-AttachVolumeShelveTestJSON-801976804-project-member</nova:user>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:project uuid="b3670195fbec411c891e3ea8820b01d1">tempest-AttachVolumeShelveTestJSON-801976804</nova:project>
Oct 20 14:49:11 user nova-compute[76870]:       </nova:owner>
Oct 20 14:49:11 user nova-compute[76870]:       <nova:root type="image" uuid="212962fd-e5fe-4bcb-9700-85f5289c1f42"/>
Oct 20 14:49:11 user nova-compute[76870]:       <nova:ports>
Oct 20 14:49:11 user nova-compute[76870]:         <nova:port uuid="137fb91e-867b-4702-8cd1-dcfdf81a25a7">
Oct 20 14:49:11 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 14:49:11 user nova-compute[76870]:         </nova:port>
Oct 20 14:49:11 user nova-compute[76870]:       </nova:ports>
Oct 20 14:49:11 user nova-compute[76870]:     </nova:instance>
Oct 20 14:49:11 user nova-compute[76870]:   </metadata>
Oct 20 14:49:11 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:49:11 user nova-compute[76870]:     <system>
Oct 20 14:49:11 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:49:11 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:49:11 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:49:11 user nova-compute[76870]:       <entry name="serial">4e56958e-edf4-4912-ac47-1ce9da96145f</entry>
Oct 20 14:49:11 user nova-compute[76870]:       <entry name="uuid">4e56958e-edf4-4912-ac47-1ce9da96145f</entry>
Oct 20 14:49:11 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:49:11 user nova-compute[76870]:     </system>
Oct 20 14:49:11 user nova-compute[76870]:   </sysinfo>
Oct 20 14:49:11 user nova-compute[76870]:   <os>
Oct 20 14:49:11 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:49:11 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:49:11 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:49:11 user nova-compute[76870]:   </os>
Oct 20 14:49:11 user nova-compute[76870]:   <features>
Oct 20 14:49:11 user nova-compute[76870]:     <acpi/>
Oct 20 14:49:11 user nova-compute[76870]:     <apic/>
Oct 20 14:49:11 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:49:11 user nova-compute[76870]:   </features>
Oct 20 14:49:11 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:49:11 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:49:11 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:49:11 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:49:11 user nova-compute[76870]:   </clock>
Oct 20 14:49:11 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:49:11 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:49:11 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:49:11 user nova-compute[76870]:   </cpu>
Oct 20 14:49:11 user nova-compute[76870]:   <devices>
Oct 20 14:49:11 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:49:11 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:49:11 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk"/>
Oct 20 14:49:11 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:49:11 user nova-compute[76870]:     </disk>
Oct 20 14:49:11 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:49:11 user nova-compute[76870]:       <mac address="fa:16:3e:9a:52:77"/>
Oct 20 14:49:11 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:49:11 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:49:11 user nova-compute[76870]:       <target dev="tap137fb91e-86"/>
Oct 20 14:49:11 user nova-compute[76870]:     </interface>
Oct 20 14:49:11 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:49:11 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/console.log" append="off"/>
Oct 20 14:49:11 user nova-compute[76870]:     </serial>
Oct 20 14:49:11 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:49:11 user nova-compute[76870]:     <video>
Oct 20 14:49:11 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:49:11 user nova-compute[76870]:     </video>
Oct 20 14:49:11 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:49:11 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:49:11 user nova-compute[76870]:     </rng>
Oct 20 14:49:11 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:49:11 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:49:11 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:49:11 user nova-compute[76870]:     </memballoon>
Oct 20 14:49:11 user nova-compute[76870]:   </devices>
Oct 20 14:49:11 user nova-compute[76870]: </domain>
Oct 20 14:49:11 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1814354559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1814354559',id=25,image_ref='212962fd-e5fe-4bcb-9700-85f5289c1f42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-454063210',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-s75dwr07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member',shelved_at='2023-10-20T14:47:14.201357',shelved_host='user',shelved_image_id='212962fd-e5fe-4bcb-9700-85f5289c1f42'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=4e56958e-edf4-4912-ac47-1ce9da96145f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG os_vif [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b81d6e-3b33-5222-9423-3b7f8ca94116', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap137fb91e-86, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap137fb91e-86, col_values=(('qos', UUID('3e96cbf4-60f2-481b-949b-2b816fdeac14')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap137fb91e-86, col_values=(('external_ids', {'iface-id': '137fb91e-867b-4702-8cd1-dcfdf81a25a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:52:77', 'vm-uuid': '4e56958e-edf4-4912-ac47-1ce9da96145f'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:11 user nova-compute[76870]: INFO os_vif [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86')
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] No VIF found with MAC fa:16:3e:9a:52:77, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmeKxYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:49:12 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:12 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:12 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fea694-1044-4587-981e-95f7989689bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:49:12 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05153635-70a5-4e00-9a7e-48c84e9e0519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a] added
Oct 20 14:49:12 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b631c-bed6-417c-9a40-abc4d62463ff]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907bf09-94d8-478c-8153-7a836f6eb35e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRmeKxYT {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRmeKxYT" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6453298e-35e1-4ee1-80e9-451af8ef2c45]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRmeKxYT'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a684b5-0937-4ecc-8193-1e73732778f2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[434cc4c0-a811-4cce-811e-f30999a1de4f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:49:12 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:49:12 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:12 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 14:49:12 user nova-compute[76870]: 
Oct 20 14:49:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-129d211c-da6a-4ea3-ae94-bbd7b25053a5 req-62880fb2-d4bf-4eab-8753-25918176df7b service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-129d211c-da6a-4ea3-ae94-bbd7b25053a5 req-62880fb2-d4bf-4eab-8753-25918176df7b service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-129d211c-da6a-4ea3-ae94-bbd7b25053a5 req-62880fb2-d4bf-4eab-8753-25918176df7b service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-129d211c-da6a-4ea3-ae94-bbd7b25053a5 req-62880fb2-d4bf-4eab-8753-25918176df7b service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-129d211c-da6a-4ea3-ae94-bbd7b25053a5 req-62880fb2-d4bf-4eab-8753-25918176df7b service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:13 user nova-compute[76870]: WARNING nova.compute.manager [req-129d211c-da6a-4ea3-ae94-bbd7b25053a5 req-62880fb2-d4bf-4eab-8753-25918176df7b service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 14:49:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --login" returned: 0 in 1.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0280df7-7b61-49e0-8617-646ffe1418d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260]
Oct 20 14:49:13 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260] successful.
Oct 20 14:49:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[651cde33-4ce2-4bf3-a034-3aa99f9a6252]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9292a6f-47ac-451b-80ef-0d67e0d9926a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.273s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a697ac4-8de4-41cd-9fba-dce97c35caa4]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmeKxYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.307s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] <== connect_volume: return (2308ms) {'type': 'block', 'scsi_wwn': '26564656564303232', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564656564303232', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'flavor' on Instance uuid a16a3e38-cf87-4bb7-a0eb-e2e9537df659 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:49:14 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:49:14 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:49:14 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:49:14 user nova-compute[76870]:   <serial>6c9b3707-f496-4cd2-8396-5aaa35f0e37a</serial>
Oct 20 14:49:14 user nova-compute[76870]: </disk>
Oct 20 14:49:14 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-cc9bfe76-524a-4dda-82d5-efbbf7ee791b req-7e776b93-bb42-4557-988d-16c09dc703ff service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cc9bfe76-524a-4dda-82d5-efbbf7ee791b req-7e776b93-bb42-4557-988d-16c09dc703ff service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cc9bfe76-524a-4dda-82d5-efbbf7ee791b req-7e776b93-bb42-4557-988d-16c09dc703ff service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cc9bfe76-524a-4dda-82d5-efbbf7ee791b req-7e776b93-bb42-4557-988d-16c09dc703ff service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-cc9bfe76-524a-4dda-82d5-efbbf7ee791b req-7e776b93-bb42-4557-988d-16c09dc703ff service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:15 user nova-compute[76870]: WARNING nova.compute.manager [req-cc9bfe76-524a-4dda-82d5-efbbf7ee791b req-7e776b93-bb42-4557-988d-16c09dc703ff service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:49:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance spawned successfully.
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] No VIF found with MAC fa:16:3e:d4:a0:4c, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a84c2467-dc0a-4a03-811b-49dbade5159b tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.839s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-84090866-1cfa-435f-b398-9f0e287b96da tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.640s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing instance network info cache due to event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:49:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:49:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:49:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:49:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:19 user nova-compute[76870]: DEBUG nova.network.neutron [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updated VIF entry in instance network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:49:19 user nova-compute[76870]: DEBUG nova.network.neutron [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1afd9965-93d7-4423-bae0-fd58355b5fc8 req-ca4d4af8-7b07-4589-92f2-6eb0629a7197 service nova] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:49:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing instance network info cache due to event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:49:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:49:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:49:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:49:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:22 user nova-compute[76870]: INFO nova.compute.manager [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Rebooting instance
Oct 20 14:49:22 user nova-compute[76870]: DEBUG nova.network.neutron [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updated VIF entry in instance network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG nova.network.neutron [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1e0167d1-d1c8-4022-9e67-b614bf08966e req-ba364a61-5141-446b-b3f8-f1a11bf8b43b service nova] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:49:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOasVmnk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:49:24 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:24 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:24 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4660f74c-152f-4a0a-9329-cfcf0fc71a87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:49:24 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[369a622d-ba6f-4deb-943e-b399f30672e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4] added
Oct 20 14:49:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f5aa9e-3526-480c-a069-43fa83ef95d2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c375670-a1d5-49d6-aa25-7926d7ca4c5f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOasVmnk {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOasVmnk" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca50a04-c1b4-4a52-ac60-a1ae0ff181e8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOasVmnk'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758dc92-3b46-4143-9422-018240f819a9]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b8aa8-5083-4da3-8284-45b42ad1a419]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af2892-061c-4a80-a6ae-f58351ece99c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260]
Oct 20 14:49:25 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260] successful.
Oct 20 14:49:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e54a653-7fbb-4de7-abff-fedebe568840]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b2763e-d2d9-4571-bdfa-7a8cec2fa023]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:25 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:49:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:25 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:49:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576d1d6-f246-4866-999b-d79fa8dc0395]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOasVmnk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-549a6952-8866-4d58-bb4c-8a3f77747555 req-6c66a961-e9ea-4633-8a2e-3286de71cc92 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-unplugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-549a6952-8866-4d58-bb4c-8a3f77747555 req-6c66a961-e9ea-4633-8a2e-3286de71cc92 service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-549a6952-8866-4d58-bb4c-8a3f77747555 req-6c66a961-e9ea-4633-8a2e-3286de71cc92 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-549a6952-8866-4d58-bb4c-8a3f77747555 req-6c66a961-e9ea-4633-8a2e-3286de71cc92 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-549a6952-8866-4d58-bb4c-8a3f77747555 req-6c66a961-e9ea-4633-8a2e-3286de71cc92 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-unplugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:25 user nova-compute[76870]: WARNING nova.compute.manager [req-549a6952-8866-4d58-bb4c-8a3f77747555 req-6c66a961-e9ea-4633-8a2e-3286de71cc92 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-unplugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state active and task_state reboot_started.
Oct 20 14:49:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23036386430343062', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036386430343062', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:49:26 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:49:26 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:49:26 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:49:26 user nova-compute[76870]:   <serial>853765a3-86d8-437a-ab81-213751dc7ec4</serial>
Oct 20 14:49:26 user nova-compute[76870]: </disk>
Oct 20 14:49:26 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:49:26 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance shutdown successfully.
Oct 20 14:49:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No VIF found with MAC fa:16:3e:49:c7:2f, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:49:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-af51e5e2-80b0-4e91-880c-c1e724e7015d tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.776s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-eb1e578e-e24b-454e-a1e6-57230504c70a req-7dc523b0-8d67-4bd6-8124-b81baa0e4794 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-eb1e578e-e24b-454e-a1e6-57230504c70a req-7dc523b0-8d67-4bd6-8124-b81baa0e4794 service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-eb1e578e-e24b-454e-a1e6-57230504c70a req-7dc523b0-8d67-4bd6-8124-b81baa0e4794 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-eb1e578e-e24b-454e-a1e6-57230504c70a req-7dc523b0-8d67-4bd6-8124-b81baa0e4794 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-eb1e578e-e24b-454e-a1e6-57230504c70a req-7dc523b0-8d67-4bd6-8124-b81baa0e4794 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:27 user nova-compute[76870]: WARNING nova.compute.manager [req-eb1e578e-e24b-454e-a1e6-57230504c70a req-7dc523b0-8d67-4bd6-8124-b81baa0e4794 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state active and task_state reboot_started.
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:29 user nova-compute[76870]: WARNING nova.compute.manager [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state active and task_state reboot_started.
Oct 20 14:49:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:29 user nova-compute[76870]: WARNING nova.compute.manager [req-4d90fd24-178d-4066-a8e4-bde48691f11b req-4ca68f4f-f389-49f1-8ae2-0aea0bba5817 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state active and task_state reboot_started.
Oct 20 14:49:30 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance running successfully.
Oct 20 14:49:30 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance soft rebooted successfully.
Oct 20 14:49:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:49:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b09f83f5-76a3-4820-a363-ace8e6616102 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.223s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:33 user nova-compute[76870]: INFO nova.compute.manager [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attaching volume 8b336eb4-b6d6-4600-a644-a8d7a97ff469 to /dev/vdc
Oct 20 14:49:33 user nova-compute[76870]: DEBUG os_brick.utils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6140672-91b8-43be-9c5c-821c674c3f2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27087c5-cd93-45a9-b1c8-2bdf8e3ad75f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a41427-9c5d-4617-8f15-6e9874b0272a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945b2a6-f142-4f0c-8df8-4b5aaa34ba2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:49:33 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:49:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a10e3-cc02-4e55-a8ee-3f3fb33e4872]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG os_brick.utils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:49:33 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updating existing volume attachment record: e00d6565-bfbb-4ccc-839f-272abd106555 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:49:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:49:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:45 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:49:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:46 user nova-compute[76870]: INFO nova.compute.manager [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Terminating instance
Oct 20 14:49:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-aff06a5c-c41d-42b6-b04c-6ea841e6d304 req-51c28ff4-bdc1-46f0-b7df-148a56834b06 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-vif-unplugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aff06a5c-c41d-42b6-b04c-6ea841e6d304 req-51c28ff4-bdc1-46f0-b7df-148a56834b06 service nova] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aff06a5c-c41d-42b6-b04c-6ea841e6d304 req-51c28ff4-bdc1-46f0-b7df-148a56834b06 service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aff06a5c-c41d-42b6-b04c-6ea841e6d304 req-51c28ff4-bdc1-46f0-b7df-148a56834b06 service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-aff06a5c-c41d-42b6-b04c-6ea841e6d304 req-51c28ff4-bdc1-46f0-b7df-148a56834b06 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] No waiting events found dispatching network-vif-unplugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-aff06a5c-c41d-42b6-b04c-6ea841e6d304 req-51c28ff4-bdc1-46f0-b7df-148a56834b06 service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-vif-unplugged-b6790ddf-f3fd-4d20-b348-1f1881405cde for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Instance destroyed successfully.
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lazy-loading 'resources' on Instance uuid f6030b28-c422-408a-b1b2-5066fd2ea32f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1850568706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1850568',id=29,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEX/bFYBQ0hDgt1VuvzHNKsyPd8yZQRet0jgcG7fr4xuGgRNrGM/Dux34Tq4F+g8ooH2YWhldoURbtG9FREDsH3py+PQM/572s0AfLlGrofZMIGqU9zY2CRn7xsJEnpfA==',key_name='tempest-keypair-1901193495',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b99632d22924259ba135054b103399a',ramdisk_id='',reservation_id='r-qzc643jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1260542710',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:46:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f7b1202b96045c2939d41639118d7ad',uuid=f6030b28-c422-408a-b1b2-5066fd2ea32f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Converting VIF {"id": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "address": "fa:16:3e:40:cf:a5", "network": {"id": "7899df87-209e-4e2d-9f58-6984626015fe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1061492461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b99632d22924259ba135054b103399a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6790ddf-f3", "ovs_interfaceid": "b6790ddf-f3fd-4d20-b348-1f1881405cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG os_vif [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6790ddf-f3, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5146643f-4de6-4c34-9af8-ae68a1095cad) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:47 user nova-compute[76870]: INFO os_vif [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:cf:a5,bridge_name='br-int',has_traffic_filtering=True,id=b6790ddf-f3fd-4d20-b348-1f1881405cde,network=Network(7899df87-209e-4e2d-9f58-6984626015fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6790ddf-f3')
Oct 20 14:49:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Deleting instance files /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f_del
Oct 20 14:49:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Deletion of /opt/stack/data/nova/instances/f6030b28-c422-408a-b1b2-5066fd2ea32f_del complete
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:47 user nova-compute[76870]: INFO nova.compute.manager [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:49:47 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid 'f6030b28-c422-408a-b1b2-5066fd2ea32f' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f6030b28-c422-408a-b1b2-5066fd2ea32f' (instance-0000001d)
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-a74e9b05-cbb9-4c98-82ab-863bb2445d0e req-3d5c9113-5489-4708-b994-012a0b3488bb service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-vif-deleted-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:48 user nova-compute[76870]: INFO nova.compute.manager [req-a74e9b05-cbb9-4c98-82ab-863bb2445d0e req-3d5c9113-5489-4708-b994-012a0b3488bb service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Neutron deleted interface b6790ddf-f3fd-4d20-b348-1f1881405cde; detaching it from the instance and deleting it from the info cache
Oct 20 14:49:48 user nova-compute[76870]: DEBUG nova.network.neutron [req-a74e9b05-cbb9-4c98-82ab-863bb2445d0e req-3d5c9113-5489-4708-b994-012a0b3488bb service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:48 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Took 1.07 seconds to deallocate network for instance.
Oct 20 14:49:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-a74e9b05-cbb9-4c98-82ab-863bb2445d0e req-3d5c9113-5489-4708-b994-012a0b3488bb service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Detach interface failed, port_id=b6790ddf-f3fd-4d20-b348-1f1881405cde, reason: Instance f6030b28-c422-408a-b1b2-5066fd2ea32f could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-d52227b7-c4e2-452a-a9e3-2a408e743575 req-450e4303-e2e6-4d75-96ab-7b148315785a service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received event network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d52227b7-c4e2-452a-a9e3-2a408e743575 req-450e4303-e2e6-4d75-96ab-7b148315785a service nova] Acquiring lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d52227b7-c4e2-452a-a9e3-2a408e743575 req-450e4303-e2e6-4d75-96ab-7b148315785a service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d52227b7-c4e2-452a-a9e3-2a408e743575 req-450e4303-e2e6-4d75-96ab-7b148315785a service nova] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-d52227b7-c4e2-452a-a9e3-2a408e743575 req-450e4303-e2e6-4d75-96ab-7b148315785a service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] No waiting events found dispatching network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:49:49 user nova-compute[76870]: WARNING nova.compute.manager [req-d52227b7-c4e2-452a-a9e3-2a408e743575 req-450e4303-e2e6-4d75-96ab-7b148315785a service nova] [instance: f6030b28-c422-408a-b1b2-5066fd2ea32f] Received unexpected event network-vif-plugged-b6790ddf-f3fd-4d20-b348-1f1881405cde for instance with vm_state deleted and task_state None.
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:49 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Deleted allocations for instance f6030b28-c422-408a-b1b2-5066fd2ea32f
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5f34f05b-338b-46bc-a561-8b2485e2741f tempest-TestServerVolumeAttachScenarioOldVersion-1260542710 tempest-TestServerVolumeAttachScenarioOldVersion-1260542710-project-member] Lock "f6030b28-c422-408a-b1b2-5066fd2ea32f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.116s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:49 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:49:49 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=7703MB free_disk=25.050636291503906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 29576bee-2c13-41f3-829f-09b61067efdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 495e547d-9819-4017-bf66-0c559c1feb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 4e56958e-edf4-4912-ac47-1ce9da96145f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:49:49 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:49:50 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:49:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:49:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:49:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDbNsESR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:49:51 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:52 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:49:52 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509466b-ee3f-4f0c-ada9-d9065d172e79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:49:52 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9d052-5607-4e3c-aa90-bdb60ecf8f6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469] added
Oct 20 14:49:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5caada-0520-479a-a5ff-55901fed5eff]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e08ce5b-bd46-46bf-bddd-24320570fb9e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDbNsESR {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDbNsESR" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288712a-2910-4564-a1fe-0a4474879fb6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDbNsESR'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfd93ac-dfea-4068-a141-81947f2e515c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb0cfe-d70e-49bf-aee2-c7e42814a16f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:52 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:49:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:52 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:49:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[847c60d3-7e2b-489e-b2ba-ae4b29d22f94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260]
Oct 20 14:49:52 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260] successful.
Oct 20 14:49:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1494831a-fe2e-41a8-8d69-5d09c3c3d2df]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a0c865-7032-4f81-986e-546c8edeec1e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:52 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:49:52 user nova-compute[76870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)
Oct 20 14:49:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:49:52 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:49:52 user nova-compute[76870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)
Oct 20 14:49:52 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea28671-a850-4474-930d-0ae9132ba7b0]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDbNsESR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:49:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26133663361373462', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663361373462', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:49:53 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:49:53 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 14:49:53 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:49:53 user nova-compute[76870]:   <serial>8b336eb4-b6d6-4600-a644-a8d7a97ff469</serial>
Oct 20 14:49:53 user nova-compute[76870]: </disk>
Oct 20 14:49:53 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] No VIF found with MAC fa:16:3e:49:c7:2f, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:49:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e97d184c-2308-4232-98f7-74401047fbeb tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.627s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:49:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:49:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:49:54 user nova-compute[76870]: INFO nova.compute.manager [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Detaching volume 853765a3-86d8-437a-ab81-213751dc7ec4
Oct 20 14:49:54 user nova-compute[76870]: INFO nova.virt.block_device [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attempting to driver detach volume 853765a3-86d8-437a-ab81-213751dc7ec4 from mountpoint /dev/vdb
Oct 20 14:49:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Attempting to detach device vdb from instance 29576bee-2c13-41f3-829f-09b61067efdc from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:49:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:49:54 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:49:54 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:49:54 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:49:54 user nova-compute[76870]:   <serial>853765a3-86d8-437a-ab81-213751dc7ec4</serial>
Oct 20 14:49:54 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:49:54 user nova-compute[76870]: </disk>
Oct 20 14:49:54 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:49:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully detached device vdb from instance 29576bee-2c13-41f3-829f-09b61067efdc from the persistent domain config.
Oct 20 14:49:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29576bee-2c13-41f3-829f-09b61067efdc from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:49:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:49:54 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:49:54 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:49:54 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:49:54 user nova-compute[76870]:   <serial>853765a3-86d8-437a-ab81-213751dc7ec4</serial>
Oct 20 14:49:54 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:49:54 user nova-compute[76870]: </disk>
Oct 20 14:49:54 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:49:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:49:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:49:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-changed-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG nova.compute.manager [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Refreshing instance network info cache due to event network-changed-d356c304-4b97-4e10-82a5-fd3ba7090d8d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] Acquiring lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] Acquired lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Refreshing network info cache for port d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updated VIF entry in instance network info cache for port d356c304-4b97-4e10-82a5-fd3ba7090d8d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updating instance_info_cache with network_info: [{"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:50:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9197a2b9-c07c-4bd3-82f4-40b5a3e21af3 req-a4245d64-1b66-4a73-b770-b47c2d8d6448 service nova] Releasing lock "refresh_cache-495e547d-9819-4017-bf66-0c559c1feb1f" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:50:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:15 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 29576bee-2c13-41f3-829f-09b61067efdc is timed out.
Oct 20 14:50:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully detached device vdb from instance 29576bee-2c13-41f3-829f-09b61067efdc from the live domain config.
Oct 20 14:50:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOasVmnk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:50:15 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[121fd50b-ba4c-414f-92d5-3f33991ace8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:50:15 user nova-compute[76870]: No targets found.
Oct 20 14:50:15 user nova-compute[76870]: iSNS:
Oct 20 14:50:15 user nova-compute[76870]: No targets found.
Oct 20 14:50:15 user nova-compute[76870]: STATIC:
Oct 20 14:50:15 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4
Oct 20 14:50:15 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:50:15 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:50:15 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469
Oct 20 14:50:15 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:50:15 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:50:15 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a
Oct 20 14:50:15 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:50:15 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:50:15 user nova-compute[76870]: FIRMWARE:
Oct 20 14:50:15 user nova-compute[76870]: No targets found.
Oct 20 14:50:15 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:50:15 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:50:15 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[942043fe-5a2d-44e9-a7c4-4ed20ed9cf28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[619955bc-e872-42f3-8474-5ecdf12c8150]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:15 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:50:15 user nova-compute[76870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)
Oct 20 14:50:15 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:15 user nova-compute[76870]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 (non-flash)
Oct 20 14:50:15 user nova-compute[76870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)
Oct 20 14:50:15 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c3be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8430ecf-2095-4eb7-a9e6-e339a0703ecf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d4e09-d340-4542-b222-fba300f9cba9]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccf394c-8a1a-4665-bfe9-378b26e49504]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[742c97cb-ae5e-493f-8292-3672cf32d8b1]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68b0f46-1253-48ce-9ec2-ec48bb9b3872]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9302bce-564d-4514-bcf4-354f15d0943e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260]
Oct 20 14:50:15 user nova-compute[76870]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4, portal: 172.16.0.220,3260] successful.
Oct 20 14:50:15 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853765a3-86d8-437a-ab81-213751dc7ec4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a46f7c-fdd4-4af9-8a37-7edc727a5f91]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== disconnect_volume: return (292ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:50:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:50:16 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4924ebdc-2cfd-4433-a0fb-7afc49256104 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.729s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid 495e547d-9819-4017-bf66-0c559c1feb1f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:17 user nova-compute[76870]: INFO nova.compute.manager [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Attaching volume 227fe5aa-4545-422d-b3b0-7642dd5c5f94 to /dev/vdb
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:17 user nova-compute[76870]: INFO nova.compute.manager [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Detaching volume 8b336eb4-b6d6-4600-a644-a8d7a97ff469
Oct 20 14:50:17 user nova-compute[76870]: DEBUG os_brick.utils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[78891937-e2f8-4aac-811a-61d961e4c017]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:17 user nova-compute[76870]: INFO nova.virt.block_device [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Attempting to driver detach volume 8b336eb4-b6d6-4600-a644-a8d7a97ff469 from mountpoint /dev/vdc
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482a32d-704b-41df-95a4-20f98a3bd083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Attempting to detach device vdc from instance 29576bee-2c13-41f3-829f-09b61067efdc from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:50:17 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:50:17 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 14:50:17 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:50:17 user nova-compute[76870]:   <serial>8b336eb4-b6d6-4600-a644-a8d7a97ff469</serial>
Oct 20 14:50:17 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 14:50:17 user nova-compute[76870]: </disk>
Oct 20 14:50:17 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully detached device vdc from instance 29576bee-2c13-41f3-829f-09b61067efdc from the persistent domain config.
Oct 20 14:50:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 29576bee-2c13-41f3-829f-09b61067efdc from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:50:17 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:50:17 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 14:50:17 user nova-compute[76870]:   <target dev="vdc" bus="virtio"/>
Oct 20 14:50:17 user nova-compute[76870]:   <serial>8b336eb4-b6d6-4600-a644-a8d7a97ff469</serial>
Oct 20 14:50:17 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 14:50:17 user nova-compute[76870]: </disk>
Oct 20 14:50:17 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea6dd4-2318-4849-b34f-448eddb860cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9756e8d8-cb5c-4826-a9e9-d440627926d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:50:17 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:50:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc9846-21af-4fc9-9b2b-8ad0e26f96ae]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG os_brick.utils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:50:17 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updating existing volume attachment record: 0cc170ba-318f-40e9-8df4-e485e8ed44a1 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:50:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:50:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:36 user nova-compute[76870]: INFO nova.compute.manager [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Rescuing
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-6ecf5901-e7ca-406a-ad8a-23dd1243ed9b req-518bc46d-cec5-4df0-bc14-02c4d1c4d151 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6ecf5901-e7ca-406a-ad8a-23dd1243ed9b req-518bc46d-cec5-4df0-bc14-02c4d1c4d151 service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6ecf5901-e7ca-406a-ad8a-23dd1243ed9b req-518bc46d-cec5-4df0-bc14-02c4d1c4d151 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6ecf5901-e7ca-406a-ad8a-23dd1243ed9b req-518bc46d-cec5-4df0-bc14-02c4d1c4d151 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-6ecf5901-e7ca-406a-ad8a-23dd1243ed9b req-518bc46d-cec5-4df0-bc14-02c4d1c4d151 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:36 user nova-compute[76870]: WARNING nova.compute.manager [req-6ecf5901-e7ca-406a-ad8a-23dd1243ed9b req-518bc46d-cec5-4df0-bc14-02c4d1c4d151 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state active and task_state rescuing.
Oct 20 14:50:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance destroyed successfully.
Oct 20 14:50:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Attempting rescue
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 14:50:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Creating image(s)
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'migration_context' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.base [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<0ef00916-b444-490b-a221-81f18276baaa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Start _get_guest_xml network_info=[{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:21:5a:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'resources' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.base [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<0ef00916-b444-490b-a221-81f18276baaa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.base [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<0ef00916-b444-490b-a221-81f18276baaa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:50:37 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:50:37 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.base [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<0ef00916-b444-490b-a221-81f18276baaa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107637266',display_name='tempest-ServerRescueNegativeTestJSON-server-1107637266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107637266',id=27,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:45:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-72q7sghr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:45:56Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=0ef00916-b444-490b-a221-81f18276baaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:21:5a:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:21:5a:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.objects.base [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<0ef00916-b444-490b-a221-81f18276baaa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:50:37 user nova-compute[76870]:   <uuid>0ef00916-b444-490b-a221-81f18276baaa</uuid>
Oct 20 14:50:37 user nova-compute[76870]:   <name>instance-0000001b</name>
Oct 20 14:50:37 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:50:37 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:50:37 user nova-compute[76870]:   <metadata>
Oct 20 14:50:37 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:50:37 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:50:37 user nova-compute[76870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1107637266</nova:name>
Oct 20 14:50:37 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:50:37</nova:creationTime>
Oct 20 14:50:37 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:50:37 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:50:37 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:50:37 user nova-compute[76870]:       <nova:owner>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:user uuid="fdd157499df5446e8c082732e1fbd278">tempest-ServerRescueNegativeTestJSON-1475360384-project-member</nova:user>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:project uuid="5bb2d2209f464235949db2d48ec8e2eb">tempest-ServerRescueNegativeTestJSON-1475360384</nova:project>
Oct 20 14:50:37 user nova-compute[76870]:       </nova:owner>
Oct 20 14:50:37 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:50:37 user nova-compute[76870]:       <nova:ports>
Oct 20 14:50:37 user nova-compute[76870]:         <nova:port uuid="845e035b-f600-4801-91e4-da31116e9430">
Oct 20 14:50:37 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 14:50:37 user nova-compute[76870]:         </nova:port>
Oct 20 14:50:37 user nova-compute[76870]:       </nova:ports>
Oct 20 14:50:37 user nova-compute[76870]:     </nova:instance>
Oct 20 14:50:37 user nova-compute[76870]:   </metadata>
Oct 20 14:50:37 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:50:37 user nova-compute[76870]:     <system>
Oct 20 14:50:37 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:50:37 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:50:37 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:50:37 user nova-compute[76870]:       <entry name="serial">0ef00916-b444-490b-a221-81f18276baaa</entry>
Oct 20 14:50:37 user nova-compute[76870]:       <entry name="uuid">0ef00916-b444-490b-a221-81f18276baaa</entry>
Oct 20 14:50:37 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:50:37 user nova-compute[76870]:     </system>
Oct 20 14:50:37 user nova-compute[76870]:   </sysinfo>
Oct 20 14:50:37 user nova-compute[76870]:   <os>
Oct 20 14:50:37 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:50:37 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:50:37 user nova-compute[76870]:   </os>
Oct 20 14:50:37 user nova-compute[76870]:   <features>
Oct 20 14:50:37 user nova-compute[76870]:     <acpi/>
Oct 20 14:50:37 user nova-compute[76870]:     <apic/>
Oct 20 14:50:37 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:50:37 user nova-compute[76870]:   </features>
Oct 20 14:50:37 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:50:37 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:50:37 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:50:37 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:50:37 user nova-compute[76870]:   </clock>
Oct 20 14:50:37 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:50:37 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:50:37 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:50:37 user nova-compute[76870]:   </cpu>
Oct 20 14:50:37 user nova-compute[76870]:   <devices>
Oct 20 14:50:37 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:50:37 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:50:37 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue"/>
Oct 20 14:50:37 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:50:37 user nova-compute[76870]:     </disk>
Oct 20 14:50:37 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:50:37 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:50:37 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk"/>
Oct 20 14:50:37 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:50:37 user nova-compute[76870]:     </disk>
Oct 20 14:50:37 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:50:37 user nova-compute[76870]:       <mac address="fa:16:3e:21:5a:d1"/>
Oct 20 14:50:37 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:50:37 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:50:37 user nova-compute[76870]:       <target dev="tap845e035b-f6"/>
Oct 20 14:50:37 user nova-compute[76870]:     </interface>
Oct 20 14:50:37 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:50:37 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/console.log" append="off"/>
Oct 20 14:50:37 user nova-compute[76870]:     </serial>
Oct 20 14:50:37 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:50:37 user nova-compute[76870]:     <video>
Oct 20 14:50:37 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:50:37 user nova-compute[76870]:     </video>
Oct 20 14:50:37 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:50:37 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:50:37 user nova-compute[76870]:     </rng>
Oct 20 14:50:37 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:50:37 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:50:37 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:50:37 user nova-compute[76870]:     </memballoon>
Oct 20 14:50:37 user nova-compute[76870]:   </devices>
Oct 20 14:50:37 user nova-compute[76870]: </domain>
Oct 20 14:50:37 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:50:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance destroyed successfully.
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:50:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:21:5a:d1, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:50:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 29576bee-2c13-41f3-829f-09b61067efdc is timed out.
Oct 20 14:50:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully detached device vdc from instance 29576bee-2c13-41f3-829f-09b61067efdc from the live domain config.
Oct 20 14:50:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDbNsESR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:50:38 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad09973-44fb-4418-bd71-475b232e328e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:50:38 user nova-compute[76870]: No targets found.
Oct 20 14:50:38 user nova-compute[76870]: iSNS:
Oct 20 14:50:38 user nova-compute[76870]: No targets found.
Oct 20 14:50:38 user nova-compute[76870]: STATIC:
Oct 20 14:50:38 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469
Oct 20 14:50:38 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:50:38 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:50:38 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a
Oct 20 14:50:38 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:50:38 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:50:38 user nova-compute[76870]: FIRMWARE:
Oct 20 14:50:38 user nova-compute[76870]: No targets found.
Oct 20 14:50:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:50:38 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:50:38 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ead354-ddde-4f1d-a8c7-e229bd8fc324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc263eb-9891-4a61-a45f-a8b1b69f1b74]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:38 user nova-compute[76870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)
Oct 20 14:50:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:38 user nova-compute[76870]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 (non-flash)
Oct 20 14:50:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf84976d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e34094-e899-4598-8226-2b8677263435]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c670c9a7-d103-438a-a255-dfd3f460350c]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883e126-da5e-420b-bead-2c95c1058d7e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66cbde-7e12-4c10-8640-4cf0b335c49d]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.060s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f276d9-537b-468c-bb8e-c27ed24e796f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0adc7-efcb-4443-a409-0847307d06cc]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260]
Oct 20 14:50:38 user nova-compute[76870]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469, portal: 172.16.0.220,3260] successful.
Oct 20 14:50:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b336eb4-b6d6-4600-a644-a8d7a97ff469 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5312236-cae0-461e-8a8c-ada4754b3059]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] <== disconnect_volume: return (387ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:50:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-ad154aad-6183-4915-b7f8-faf0eedb3ba4 req-46a1fb73-665b-43d6-891b-99a8bc035a47 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ad154aad-6183-4915-b7f8-faf0eedb3ba4 req-46a1fb73-665b-43d6-891b-99a8bc035a47 service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ad154aad-6183-4915-b7f8-faf0eedb3ba4 req-46a1fb73-665b-43d6-891b-99a8bc035a47 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ad154aad-6183-4915-b7f8-faf0eedb3ba4 req-46a1fb73-665b-43d6-891b-99a8bc035a47 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-ad154aad-6183-4915-b7f8-faf0eedb3ba4 req-46a1fb73-665b-43d6-891b-99a8bc035a47 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:39 user nova-compute[76870]: WARNING nova.compute.manager [req-ad154aad-6183-4915-b7f8-faf0eedb3ba4 req-46a1fb73-665b-43d6-891b-99a8bc035a47 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state active and task_state rescuing.
Oct 20 14:50:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG nova.objects.instance [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'flavor' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-02067724-20ef-4800-b0d3-42d3504a1a15 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.993s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:40 user nova-compute[76870]: INFO nova.compute.manager [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Terminating instance
Oct 20 14:50:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:41 user nova-compute[76870]: WARNING nova.compute.manager [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state active and task_state rescuing.
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:41 user nova-compute[76870]: WARNING nova.compute.manager [req-ddf6dd82-7b0a-43f7-b580-2b7614b640ad req-ae534c63-262c-4382-b2a6-5525cf3c3ddf service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state active and task_state rescuing.
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Instance destroyed successfully.
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lazy-loading 'resources' on Instance uuid 29576bee-2c13-41f3-829f-09b61067efdc {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:47:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-821477869',display_name='tempest-AttachVolumeTestJSON-server-821477869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-821477869',id=31,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUCiTdtPTQZUiVvjBJvMi9UjOxSYrbnhhYCEHxWQYmK6llOOFsZ29niCKTspustbgg3TgnEJSCQhWKRQBcCRA5Uj5AfD/XiBc06I3uHJ6ktiRa4Tt6G5GGlVrUHG1VRcw==',key_name='tempest-keypair-1950891247',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:47:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d99999331a734dc0b3cc9fcc517dfc9a',ramdisk_id='',reservation_id='r-llf3i1fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-345124704',owner_user_name='tempest-AttachVolumeTestJSON-345124704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='859e78a4758a4cafa8e547e12126b1e4',uuid=29576bee-2c13-41f3-829f-09b61067efdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converting VIF {"id": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "address": "fa:16:3e:49:c7:2f", "network": {"id": "221e37a7-a9d4-4696-98d6-2355d4b337f8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1318452217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d99999331a734dc0b3cc9fcc517dfc9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56028f8-c4", "ovs_interfaceid": "c56028f8-c4e0-44a2-934c-42c403eca5c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG os_vif [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc56028f8-c4, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcda59c1-8dd3-4d79-b9bb-0289fb56c910) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:50:41 user nova-compute[76870]: INFO os_vif [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=c56028f8-c4e0-44a2-934c-42c403eca5c5,network=Network(221e37a7-a9d4-4696-98d6-2355d4b337f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56028f8-c4')
Oct 20 14:50:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Deleting instance files /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc_del
Oct 20 14:50:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Deletion of /opt/stack/data/nova/instances/29576bee-2c13-41f3-829f-09b61067efdc_del complete
Oct 20 14:50:41 user nova-compute[76870]: INFO nova.compute.manager [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 20 14:50:41 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:50:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-99d99504-cf27-4b41-91b8-4a953e5e6336 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:50:42 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:50:42 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Took 0.90 seconds to deallocate network for instance.
Oct 20 14:50:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-b239ec6f-c5b3-4e06-a832-f87ac13d6ff6 req-9ffcf1fb-5891-48ac-82cd-b586e18b6897 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-vif-deleted-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:42 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:50:42 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:43 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Deleted allocations for instance 29576bee-2c13-41f3-829f-09b61067efdc
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fea3eb48-751c-4f93-a729-40310e3b2144 tempest-AttachVolumeTestJSON-345124704 tempest-AttachVolumeTestJSON-345124704-project-member] Lock "29576bee-2c13-41f3-829f-09b61067efdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-vif-unplugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] No waiting events found dispatching network-vif-unplugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:43 user nova-compute[76870]: WARNING nova.compute.manager [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received unexpected event network-vif-unplugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 for instance with vm_state deleted and task_state None.
Oct 20 14:50:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received event network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] Acquiring lock "29576bee-2c13-41f3-829f-09b61067efdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] Lock "29576bee-2c13-41f3-829f-09b61067efdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] No waiting events found dispatching network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:43 user nova-compute[76870]: WARNING nova.compute.manager [req-c11c4108-bccb-4eb3-9654-cbcb8c410317 req-ac0e8167-4662-4d55-b65f-08f0ae767813 service nova] [instance: 29576bee-2c13-41f3-829f-09b61067efdc] Received unexpected event network-vif-plugged-c56028f8-c4e0-44a2-934c-42c403eca5c5 for instance with vm_state deleted and task_state None.
Oct 20 14:50:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:50:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqcjtbmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:50:47 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:50:47 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:50:47 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d701edb-7a63-4ad6-9ce3-ac95f657b595]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:50:47 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa531e-b8da-4bcc-8c62-53b230abf212]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94] added
Oct 20 14:50:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc956c4c-9e02-4ed3-809c-1009ad3ecc7b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2c4bdd-1bb4-47a5-8e2f-8137dee7a190]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqcjtbmV {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LqcjtbmV" returned: 0 in 0.051s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc4f04-3447-4ea9-b294-1e83319bb5f4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LqcjtbmV'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.078s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[88450ab6-e849-48b2-9837-1248a79fb71d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[08478d46-c373-4a40-b26e-f1662c74dca4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --login" returned: 0 in 1.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d79a24-9553-4796-be5f-ecb62defbcc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260]
Oct 20 14:50:48 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260] successful.
Oct 20 14:50:48 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b722751-4297-4e84-a29f-86740a91ade3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f15ee6-1a51-493a-8c05-830db13d9338]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:48 user nova-compute[76870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 (non-flash)
Oct 20 14:50:48 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:50:48 user nova-compute[76870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 (non-flash)
Oct 20 14:50:48 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.450s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe18d01-515f-4be5-af7c-8a806b7f3b8c]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqcjtbmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.520s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== connect_volume: return (2526ms) {'type': 'block', 'scsi_wwn': '26432313564323231', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432313564323231', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid 495e547d-9819-4017-bf66-0c559c1feb1f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:50:49 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:50:49 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:50:49 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:50:49 user nova-compute[76870]:   <serial>227fe5aa-4545-422d-b3b0-7642dd5c5f94</serial>
Oct 20 14:50:49 user nova-compute[76870]: </disk>
Oct 20 14:50:49 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:50:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:50:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8159MB free_disk=25.086078643798828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] No VIF found with MAC fa:16:3e:3d:5c:37, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 495e547d-9819-4017-bf66-0c559c1feb1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 4e56958e-edf4-4912-ac47-1ce9da96145f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c341ed96-ec56-44bb-9d86-10450038a297 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.250s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:50:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:51 user nova-compute[76870]: INFO nova.compute.manager [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Detaching volume 227fe5aa-4545-422d-b3b0-7642dd5c5f94
Oct 20 14:50:51 user nova-compute[76870]: INFO nova.virt.block_device [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Attempting to driver detach volume 227fe5aa-4545-422d-b3b0-7642dd5c5f94 from mountpoint /dev/vdb
Oct 20 14:50:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Attempting to detach device vdb from instance 495e547d-9819-4017-bf66-0c559c1feb1f from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:50:51 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:50:51 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:50:51 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:50:51 user nova-compute[76870]:   <serial>227fe5aa-4545-422d-b3b0-7642dd5c5f94</serial>
Oct 20 14:50:51 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:50:51 user nova-compute[76870]: </disk>
Oct 20 14:50:51 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:50:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully detached device vdb from instance 495e547d-9819-4017-bf66-0c559c1feb1f from the persistent domain config.
Oct 20 14:50:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 495e547d-9819-4017-bf66-0c559c1feb1f from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:50:51 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:50:51 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:50:51 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:50:51 user nova-compute[76870]:   <serial>227fe5aa-4545-422d-b3b0-7642dd5c5f94</serial>
Oct 20 14:50:51 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:50:51 user nova-compute[76870]: </disk>
Oct 20 14:50:51 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:50:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 495e547d-9819-4017-bf66-0c559c1feb1f {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:52 user nova-compute[76870]: INFO nova.compute.manager [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Terminating instance
Oct 20 14:50:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-288eb064-7c32-470c-b9d5-60430b8cf979 req-cca0058b-6596-4c4f-acef-8b88b93606f6 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-unplugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-288eb064-7c32-470c-b9d5-60430b8cf979 req-cca0058b-6596-4c4f-acef-8b88b93606f6 service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-288eb064-7c32-470c-b9d5-60430b8cf979 req-cca0058b-6596-4c4f-acef-8b88b93606f6 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-288eb064-7c32-470c-b9d5-60430b8cf979 req-cca0058b-6596-4c4f-acef-8b88b93606f6 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-288eb064-7c32-470c-b9d5-60430b8cf979 req-cca0058b-6596-4c4f-acef-8b88b93606f6 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-unplugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-288eb064-7c32-470c-b9d5-60430b8cf979 req-cca0058b-6596-4c4f-acef-8b88b93606f6 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-unplugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:50:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Instance destroyed successfully.
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lazy-loading 'resources' on Instance uuid 4e56958e-edf4-4912-ac47-1ce9da96145f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1814354559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1814354559',id=25,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTwq03L6/YGp9fIcRcBxmdb6Nkd/LyCwM55OTvK37ZjHDgm5CaHvrje1k5DI246VE7gcKlIFOq1pkOCeKOk1vCTHe/ifeVCz9kdUstA2TIsXkIPTX3Je6oaqaWEt1GNw==',key_name='tempest-keypair-454063210',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3670195fbec411c891e3ea8820b01d1',ramdisk_id='',reservation_id='r-s75dwr07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-801976804',owner_user_name='tempest-AttachVolumeShelveTestJSON-801976804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a358910175f646c39bb6d7e12ed5334e',uuid=4e56958e-edf4-4912-ac47-1ce9da96145f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converting VIF {"id": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "address": "fa:16:3e:9a:52:77", "network": {"id": "8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1743108738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3670195fbec411c891e3ea8820b01d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap137fb91e-86", "ovs_interfaceid": "137fb91e-867b-4702-8cd1-dcfdf81a25a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG os_vif [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap137fb91e-86, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e96cbf4-60f2-481b-949b-2b816fdeac14) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:53 user nova-compute[76870]: INFO os_vif [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:52:77,bridge_name='br-int',has_traffic_filtering=True,id=137fb91e-867b-4702-8cd1-dcfdf81a25a7,network=Network(8ccc68b5-6eeb-4b91-9b85-1fddd5e01d71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap137fb91e-86')
Oct 20 14:50:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Deleting instance files /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f_del
Oct 20 14:50:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Deletion of /opt/stack/data/nova/instances/4e56958e-edf4-4912-ac47-1ce9da96145f_del complete
Oct 20 14:50:53 user nova-compute[76870]: INFO nova.compute.manager [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 20 14:50:53 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:50:53 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:50:54 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:50:54 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Took 0.98 seconds to deallocate network for instance.
Oct 20 14:50:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:54 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:50:54 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:50:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:54 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Deleted allocations for instance 4e56958e-edf4-4912-ac47-1ce9da96145f
Oct 20 14:50:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] Acquiring lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:50:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:50:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] No waiting events found dispatching network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:50:55 user nova-compute[76870]: WARNING nova.compute.manager [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received unexpected event network-vif-plugged-137fb91e-867b-4702-8cd1-dcfdf81a25a7 for instance with vm_state deleted and task_state None.
Oct 20 14:50:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-d663301e-221a-4a9a-80c2-b31406a39a98 req-c6c7fae4-cd54-4252-a0df-01d89dde7f95 service nova] [instance: 4e56958e-edf4-4912-ac47-1ce9da96145f] Received event network-vif-deleted-137fb91e-867b-4702-8cd1-dcfdf81a25a7 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:50:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ed1f8be3-6b64-401a-8b02-2bfe452e2e79 tempest-AttachVolumeShelveTestJSON-801976804 tempest-AttachVolumeShelveTestJSON-801976804-project-member] Lock "4e56958e-edf4-4912-ac47-1ce9da96145f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:50:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:50:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 495e547d-9819-4017-bf66-0c559c1feb1f is timed out.
Oct 20 14:51:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully detached device vdb from instance 495e547d-9819-4017-bf66-0c559c1feb1f from the live domain config.
Oct 20 14:51:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:51:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LqcjtbmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:51:11 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:51:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:51:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:51:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1576fb-6f37-4be9-81a6-516dc407fc31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:51:12 user nova-compute[76870]: No targets found.
Oct 20 14:51:12 user nova-compute[76870]: iSNS:
Oct 20 14:51:12 user nova-compute[76870]: No targets found.
Oct 20 14:51:12 user nova-compute[76870]: STATIC:
Oct 20 14:51:12 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94
Oct 20 14:51:12 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:51:12 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:51:12 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a
Oct 20 14:51:12 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:51:12 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:51:12 user nova-compute[76870]: FIRMWARE:
Oct 20 14:51:12 user nova-compute[76870]: No targets found.
Oct 20 14:51:12 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:51:12 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:51:12 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a0960c-3092-4da5-bf7a-40c897614595]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a293efe-cc64-4192-ade6-558ac562ecae]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:51:12 user nova-compute[76870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 (non-flash)
Oct 20 14:51:12 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:51:12 user nova-compute[76870]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 (non-flash)
Oct 20 14:51:12 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8366050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19026d83-3488-4f2b-b356-4b3f373d3b5c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3534886b-7800-4952-bd10-43ea42c3a448]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f222b02-3890-4d37-8340-6f050e268bf2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88de140-b9c8-4e3f-8054-5b7afcff9c93]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6129699a-3b75-404b-9751-1d0ae16f6bc1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e1f15-c370-4f29-b9b7-0c9b67f77820]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260]
Oct 20 14:51:12 user nova-compute[76870]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94, portal: 172.16.0.220,3260] successful.
Oct 20 14:51:12 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:227fe5aa-4545-422d-b3b0-7642dd5c5f94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66502cdd-180f-456b-b5df-8fb6ba59fa17]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] <== disconnect_volume: return (269ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:51:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:51:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'flavor' on Instance uuid 495e547d-9819-4017-bf66-0c559c1feb1f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:51:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f8369716-da6a-4687-acd8-2d69dab0cf2f tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing instance network info cache due to event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updated VIF entry in instance network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:51:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ec59f83f-9c20-4639-a57e-b508116188a1 req-94a27810-9b56-4beb-914e-a9ad0a70eb41 service nova] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:51:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:15 user nova-compute[76870]: INFO nova.compute.manager [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Detaching volume 6c9b3707-f496-4cd2-8396-5aaa35f0e37a
Oct 20 14:51:15 user nova-compute[76870]: INFO nova.virt.block_device [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Attempting to driver detach volume 6c9b3707-f496-4cd2-8396-5aaa35f0e37a from mountpoint /dev/vdb
Oct 20 14:51:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Attempting to detach device vdb from instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:51:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:51:15 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:51:15 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:51:15 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:51:15 user nova-compute[76870]:   <serial>6c9b3707-f496-4cd2-8396-5aaa35f0e37a</serial>
Oct 20 14:51:15 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:51:15 user nova-compute[76870]: </disk>
Oct 20 14:51:15 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:51:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Successfully detached device vdb from instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 from the persistent domain config.
Oct 20 14:51:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:51:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:51:15 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:51:15 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:51:15 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:51:15 user nova-compute[76870]:   <serial>6c9b3707-f496-4cd2-8396-5aaa35f0e37a</serial>
Oct 20 14:51:15 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:51:15 user nova-compute[76870]: </disk>
Oct 20 14:51:15 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:51:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing instance network info cache due to event network-changed-be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Refreshing network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updated VIF entry in instance network info cache for port be363e4d-cc33-48a2-8f24-53e40c95f20d. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:51:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9c89b14b-addb-4a06-93c5-7525ae609ab0 req-a3f0d8a1-056b-4659-9ed3-da96fc1f97ac service nova] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:51:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:51:35 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 is timed out.
Oct 20 14:51:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Successfully detached device vdb from instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 from the live domain config.
Oct 20 14:51:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRmeKxYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:51:35 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f942cf-6bf2-4b7b-8ef4-a89208f8bfc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:51:35 user nova-compute[76870]: No targets found.
Oct 20 14:51:35 user nova-compute[76870]: iSNS:
Oct 20 14:51:35 user nova-compute[76870]: No targets found.
Oct 20 14:51:35 user nova-compute[76870]: STATIC:
Oct 20 14:51:35 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a
Oct 20 14:51:35 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:51:35 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:51:35 user nova-compute[76870]: FIRMWARE:
Oct 20 14:51:35 user nova-compute[76870]: No targets found.
Oct 20 14:51:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:51:35 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:51:35 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a1621-2bfa-48a7-9c2c-d3cb9c8af177]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e5f534-77cd-4f43-a282-477bd4575bde]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:51:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a (non-flash)
Oct 20 14:51:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8364c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bed6a0-1df6-4944-b34d-ff8b4b9fc48b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b542d8-793a-4f7e-90f4-4189de635e12]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f52597-d192-4189-92f3-f5478e214271]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebecf69b-339b-4258-862a-359939048ec7]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:51:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[41662372-5329-463b-a157-f1c0c1c46626]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[be017d38-18ef-400b-9b8d-6ef77ed846a8]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260]
Oct 20 14:51:36 user nova-compute[76870]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a, portal: 172.16.0.220,3260] successful.
Oct 20 14:51:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c9b3707-f496-4cd2-8396-5aaa35f0e37a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c378926-830f-4762-8759-6315b4c7881a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] <== disconnect_volume: return (275ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:51:36 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'flavor' on Instance uuid a16a3e38-cf87-4bb7-a0eb-e2e9537df659 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:51:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c572738d-8345-4068-828c-37be604bb172 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.801s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:51:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:41 user nova-compute[76870]: INFO nova.compute.manager [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Terminating instance
Oct 20 14:51:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-664f679b-924c-461e-b5d2-a5fe7d396213 req-f558a60c-4b13-4c5d-9faf-11f8a14d8644 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-vif-unplugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-664f679b-924c-461e-b5d2-a5fe7d396213 req-f558a60c-4b13-4c5d-9faf-11f8a14d8644 service nova] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-664f679b-924c-461e-b5d2-a5fe7d396213 req-f558a60c-4b13-4c5d-9faf-11f8a14d8644 service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-664f679b-924c-461e-b5d2-a5fe7d396213 req-f558a60c-4b13-4c5d-9faf-11f8a14d8644 service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-664f679b-924c-461e-b5d2-a5fe7d396213 req-f558a60c-4b13-4c5d-9faf-11f8a14d8644 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] No waiting events found dispatching network-vif-unplugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-664f679b-924c-461e-b5d2-a5fe7d396213 req-f558a60c-4b13-4c5d-9faf-11f8a14d8644 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-vif-unplugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Instance destroyed successfully.
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lazy-loading 'resources' on Instance uuid 495e547d-9819-4017-bf66-0c559c1feb1f {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2064691044',display_name='tempest-AttachVolumeNegativeTest-server-2064691044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2064691044',id=32,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3odT2gIfHUBl6cSfiKJ/XGl40Fk1RS+zyCq2/AQec9DlwKd593O9p7rRH3wlNJmmL7lJRFbBs/eD6N6gnUAcfJUCnTj6DMiNmZ3Zr9nI/FeF+h07CAH4007GpOalrZog==',key_name='tempest-keypair-906582069',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3077015e86bc441e8a6622b6af839537',ramdisk_id='',reservation_id='r-0askwtw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-742706560',owner_user_name='tempest-AttachVolumeNegativeTest-742706560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9efb8ffb0f7f47f1ab587820e0f72c91',uuid=495e547d-9819-4017-bf66-0c559c1feb1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converting VIF {"id": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "address": "fa:16:3e:3d:5c:37", "network": {"id": "1aa4f4d3-141d-49f5-977d-8795bb3fe716", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1352223603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3077015e86bc441e8a6622b6af839537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd356c304-4b", "ovs_interfaceid": "d356c304-4b97-4e10-82a5-fd3ba7090d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG os_vif [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd356c304-4b, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9e3214c-e09c-4cf2-b8d5-a73bf88e8e54) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:42 user nova-compute[76870]: INFO os_vif [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:5c:37,bridge_name='br-int',has_traffic_filtering=True,id=d356c304-4b97-4e10-82a5-fd3ba7090d8d,network=Network(1aa4f4d3-141d-49f5-977d-8795bb3fe716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd356c304-4b')
Oct 20 14:51:42 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Deleting instance files /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f_del
Oct 20 14:51:42 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Deletion of /opt/stack/data/nova/instances/495e547d-9819-4017-bf66-0c559c1feb1f_del complete
Oct 20 14:51:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:42 user nova-compute[76870]: INFO nova.compute.manager [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 14:51:42 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:51:42 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:51:43 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:51:43 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Took 0.84 seconds to deallocate network for instance.
Oct 20 14:51:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:43 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:43 user nova-compute[76870]: DEBUG nova.compute.manager [req-5838351b-b841-40b5-ab4e-fccdc999ea68 req-b339b698-bed8-4a49-a2cb-e70b06c77f3b service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-vif-deleted-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:51:43 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:44 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Deleted allocations for instance 495e547d-9819-4017-bf66-0c559c1feb1f
Oct 20 14:51:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8acf4e85-6c26-404b-a7cd-ff797eb54385 tempest-AttachVolumeNegativeTest-742706560 tempest-AttachVolumeNegativeTest-742706560-project-member] Lock "495e547d-9819-4017-bf66-0c559c1feb1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.429s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-2c4e897f-23bf-4ea7-94e8-6d8acefd30d2 req-6f33018f-9981-49c3-b14c-5ab7dd27d670 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received event network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2c4e897f-23bf-4ea7-94e8-6d8acefd30d2 req-6f33018f-9981-49c3-b14c-5ab7dd27d670 service nova] Acquiring lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2c4e897f-23bf-4ea7-94e8-6d8acefd30d2 req-6f33018f-9981-49c3-b14c-5ab7dd27d670 service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2c4e897f-23bf-4ea7-94e8-6d8acefd30d2 req-6f33018f-9981-49c3-b14c-5ab7dd27d670 service nova] Lock "495e547d-9819-4017-bf66-0c559c1feb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-2c4e897f-23bf-4ea7-94e8-6d8acefd30d2 req-6f33018f-9981-49c3-b14c-5ab7dd27d670 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] No waiting events found dispatching network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:51:44 user nova-compute[76870]: WARNING nova.compute.manager [req-2c4e897f-23bf-4ea7-94e8-6d8acefd30d2 req-6f33018f-9981-49c3-b14c-5ab7dd27d670 service nova] [instance: 495e547d-9819-4017-bf66-0c559c1feb1f] Received unexpected event network-vif-plugged-d356c304-4b97-4e10-82a5-fd3ba7090d8d for instance with vm_state deleted and task_state None.
Oct 20 14:51:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:51:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:51:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:51:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8385MB free_disk=25.130672454833984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:51:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:51:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:51:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:51:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 14:51:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [{"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-a16a3e38-cf87-4bb7-a0eb-e2e9537df659" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:51:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:51:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:51:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 14:51:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 14:51:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 3 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 14:51:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deletion of /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize failed
Oct 20 14:51:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:52:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:15 user nova-compute[76870]: INFO nova.compute.manager [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Terminating instance
Oct 20 14:52:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-dedf3ad3-99d5-46b9-814d-268c1e7996bd req-e82522af-7352-4e65-9050-dcb3d3e5f50b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-unplugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dedf3ad3-99d5-46b9-814d-268c1e7996bd req-e82522af-7352-4e65-9050-dcb3d3e5f50b service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dedf3ad3-99d5-46b9-814d-268c1e7996bd req-e82522af-7352-4e65-9050-dcb3d3e5f50b service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dedf3ad3-99d5-46b9-814d-268c1e7996bd req-e82522af-7352-4e65-9050-dcb3d3e5f50b service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-dedf3ad3-99d5-46b9-814d-268c1e7996bd req-e82522af-7352-4e65-9050-dcb3d3e5f50b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-unplugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:52:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-dedf3ad3-99d5-46b9-814d-268c1e7996bd req-e82522af-7352-4e65-9050-dcb3d3e5f50b service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-unplugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:52:16 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Instance destroyed successfully.
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lazy-loading 'resources' on Instance uuid a16a3e38-cf87-4bb7-a0eb-e2e9537df659 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-126319092',display_name='tempest-TestMinimumBasicScenario-server-126319092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-126319092',id=30,image_ref='5aea4786-dcd3-486d-a5bc-d915e6d9a4b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHNEyBbQHpCXb5WVNW47N862wE3gEAbINjYbQh728tUs4LASgdToY9W99CeyK6TDi9fachCRN8XbtUcA64EoX6c/1t5JUF0aDfvdCDKbnQvpWIHoAXX7WbzuwtmvRWdw==',key_name='tempest-TestMinimumBasicScenario-687725015',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0587d1c60494c99b9925d303898f203',ramdisk_id='',reservation_id='r-rht75m7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5aea4786-dcd3-486d-a5bc-d915e6d9a4b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1438762037',owner_user_name='tempest-TestMinimumBasicScenario-1438762037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:49:30Z,user_data=None,user_id='9ce9bea46975483190038bf47a226ced',uuid=a16a3e38-cf87-4bb7-a0eb-e2e9537df659,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converting VIF {"id": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "address": "fa:16:3e:d4:a0:4c", "network": {"id": "be619c41-f821-4f26-8b82-76295ace695d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-446271645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0587d1c60494c99b9925d303898f203", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe363e4d-cc", "ovs_interfaceid": "be363e4d-cc33-48a2-8f24-53e40c95f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG os_vif [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe363e4d-cc, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d36389a5-69ad-4915-9bd1-1d8c12ef4c9a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:16 user nova-compute[76870]: INFO os_vif [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:a0:4c,bridge_name='br-int',has_traffic_filtering=True,id=be363e4d-cc33-48a2-8f24-53e40c95f20d,network=Network(be619c41-f821-4f26-8b82-76295ace695d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe363e4d-cc')
Oct 20 14:52:16 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Deleting instance files /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659_del
Oct 20 14:52:16 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Deletion of /opt/stack/data/nova/instances/a16a3e38-cf87-4bb7-a0eb-e2e9537df659_del complete
Oct 20 14:52:16 user nova-compute[76870]: INFO nova.compute.manager [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 14:52:16 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:52:16 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Took 0.49 seconds to deallocate network for instance.
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-f8027f51-628c-40ce-ac0d-7250f4c6d110 req-66d8b03e-9f08-435b-80ef-9c4bce27a707 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-deleted-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:16 user nova-compute[76870]: INFO nova.compute.manager [req-f8027f51-628c-40ce-ac0d-7250f4c6d110 req-66d8b03e-9f08-435b-80ef-9c4bce27a707 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Neutron deleted interface be363e4d-cc33-48a2-8f24-53e40c95f20d; detaching it from the instance and deleting it from the info cache
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-f8027f51-628c-40ce-ac0d-7250f4c6d110 req-66d8b03e-9f08-435b-80ef-9c4bce27a707 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-f8027f51-628c-40ce-ac0d-7250f4c6d110 req-66d8b03e-9f08-435b-80ef-9c4bce27a707 service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Detach interface failed, port_id=be363e4d-cc33-48a2-8f24-53e40c95f20d, reason: Instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:52:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:17 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Deleted allocations for instance a16a3e38-cf87-4bb7-a0eb-e2e9537df659
Oct 20 14:52:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c2b56700-6a53-4a91-975d-f188f05b9f26 tempest-TestMinimumBasicScenario-1438762037 tempest-TestMinimumBasicScenario-1438762037-project-member] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-b47a3b38-0616-4c5e-aa28-8ace968ca547 req-b542b23e-3ceb-4518-8732-26341e7e272d service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b47a3b38-0616-4c5e-aa28-8ace968ca547 req-b542b23e-3ceb-4518-8732-26341e7e272d service nova] Acquiring lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b47a3b38-0616-4c5e-aa28-8ace968ca547 req-b542b23e-3ceb-4518-8732-26341e7e272d service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b47a3b38-0616-4c5e-aa28-8ace968ca547 req-b542b23e-3ceb-4518-8732-26341e7e272d service nova] Lock "a16a3e38-cf87-4bb7-a0eb-e2e9537df659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-b47a3b38-0616-4c5e-aa28-8ace968ca547 req-b542b23e-3ceb-4518-8732-26341e7e272d service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] No waiting events found dispatching network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:52:17 user nova-compute[76870]: WARNING nova.compute.manager [req-b47a3b38-0616-4c5e-aa28-8ace968ca547 req-b542b23e-3ceb-4518-8732-26341e7e272d service nova] [instance: a16a3e38-cf87-4bb7-a0eb-e2e9537df659] Received unexpected event network-vif-plugged-be363e4d-cc33-48a2-8f24-53e40c95f20d for instance with vm_state deleted and task_state None.
Oct 20 14:52:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:27 user nova-compute[76870]: INFO nova.compute.manager [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Unrescuing
Oct 20 14:52:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG nova.objects.instance [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'flavor' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-dfe2ee63-bd70-4df9-9aef-7042b9aa80c9 req-ba14df96-1ad7-4c6c-bcaf-19773052e31e service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dfe2ee63-bd70-4df9-9aef-7042b9aa80c9 req-ba14df96-1ad7-4c6c-bcaf-19773052e31e service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dfe2ee63-bd70-4df9-9aef-7042b9aa80c9 req-ba14df96-1ad7-4c6c-bcaf-19773052e31e service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dfe2ee63-bd70-4df9-9aef-7042b9aa80c9 req-ba14df96-1ad7-4c6c-bcaf-19773052e31e service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-dfe2ee63-bd70-4df9-9aef-7042b9aa80c9 req-ba14df96-1ad7-4c6c-bcaf-19773052e31e service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:52:27 user nova-compute[76870]: WARNING nova.compute.manager [req-dfe2ee63-bd70-4df9-9aef-7042b9aa80c9 req-ba14df96-1ad7-4c6c-bcaf-19773052e31e service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:52:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance destroyed successfully.
Oct 20 14:52:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-2a9606c3-5fb8-48b9-8f76-03f7c32954a5 req-f5c2820e-208e-40d5-ab6e-4f277ac1325e service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2a9606c3-5fb8-48b9-8f76-03f7c32954a5 req-f5c2820e-208e-40d5-ab6e-4f277ac1325e service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2a9606c3-5fb8-48b9-8f76-03f7c32954a5 req-f5c2820e-208e-40d5-ab6e-4f277ac1325e service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2a9606c3-5fb8-48b9-8f76-03f7c32954a5 req-f5c2820e-208e-40d5-ab6e-4f277ac1325e service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-2a9606c3-5fb8-48b9-8f76-03f7c32954a5 req-f5c2820e-208e-40d5-ab6e-4f277ac1325e service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:52:30 user nova-compute[76870]: WARNING nova.compute.manager [req-2a9606c3-5fb8-48b9-8f76-03f7c32954a5 req-f5c2820e-208e-40d5-ab6e-4f277ac1325e service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:52:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:52:32 user nova-compute[76870]: WARNING nova.compute.manager [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:52:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:52:32 user nova-compute[76870]: WARNING nova.compute.manager [req-5facaad9-05a8-4602-8398-50def78460e3 req-0d0eb13c-2a1e-4ea0-8b2a-54c09657cc1f service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:52:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-52da23b7-f5b9-46bf-a94a-c46dfbb38433 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:52:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:38 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:52:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:52:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:47 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:52:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:52:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:52:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:52:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=25.153778076171875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:52:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:52:51 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:52:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:52:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:52:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:52:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [{"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-663ff166-5934-49b0-bb00-4600c1c31b08" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:52:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:52:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:52:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:53:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:53:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:47 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:47 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:53:49 user nova-compute[76870]: INFO nova.compute.claims [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Claim successful on node user
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:53:49 user nova-compute[76870]: DEBUG nova.policy [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '407faf0fe9f44219a2d0580e9819f8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710a95fd9def4ae08263d4cdafbdffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:53:49 user nova-compute[76870]: INFO nova.virt.block_device [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Booting with volume snapshot 9c238d5d-00c4-47e5-880f-dda3edda518f at /dev/vda
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:53:50 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:53:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=25.17177963256836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:53:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f598b9-68b3-4ed5-9a8d-0267ea556904 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Successfully created port: ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Successfully updated port: ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "refresh_cache-f5f598b9-68b3-4ed5-9a8d-0267ea556904" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquired lock "refresh_cache-f5f598b9-68b3-4ed5-9a8d-0267ea556904" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:53:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-changed-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.compute.manager [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Refreshing instance network info cache due to event network-changed-ef8d66c7-0720-4fcf-bc91-050d25751678. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] Acquiring lock "refresh_cache-f5f598b9-68b3-4ed5-9a8d-0267ea556904" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Updating instance_info_cache with network_info: [{"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Releasing lock "refresh_cache-f5f598b9-68b3-4ed5-9a8d-0267ea556904" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Instance network_info: |[{"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] Acquired lock "refresh_cache-f5f598b9-68b3-4ed5-9a8d-0267ea556904" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.network.neutron [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Refreshing network info cache for port ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.network.neutron [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Updated VIF entry in instance network info cache for port ef8d66c7-0720-4fcf-bc91-050d25751678. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG nova.network.neutron [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Updating instance_info_cache with network_info: [{"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:53:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-85480386-ebab-4faf-b939-6465eeb74518 req-ef9e991b-ceda-4f0b-90c6-d96257f59bc8 service nova] Releasing lock "refresh_cache-f5f598b9-68b3-4ed5-9a8d-0267ea556904" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Skipping network cache update for instance because it is Building. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:53:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:53:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG os_brick.utils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fefacd-fe7e-475b-86bb-7cc7434c0d6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28947e45-3ee0-41a2-887b-c31bdec01551]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f5cf01-012e-4140-ad93-e66a770b5dd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c43cf9-d954-4d15-9b02-5738a1609ca7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:53:56 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:53:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c65662-b1c7-4fbc-92bf-e0f8d7d18cad]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG os_brick.utils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:53:56 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Updating existing volume attachment record: 78f51ce5-1983-4eb7-a844-95fe61da236e {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:54:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:54:13 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Creating image(s)
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Ensure instance console log exists: /opt/stack/data/nova/instances/f5f598b9-68b3-4ed5-9a8d-0267ea556904/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Start _get_guest_xml network_info=[{"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '78f51ce5-1983-4eb7-a844-95fe61da236e', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkytXQnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5f598b9-68b3-4ed5-9a8d-0267ea556904', 'attached_at': '', 'detached_at': '', 'volume_id': '5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256', 'serial': '5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:54:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:54:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkytXQnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:54:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:54:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:54:13 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[628d91a1-8418-4643-9228-28f14c999c29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:54:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[716c4613-618b-4f84-87d0-1b17c8fd3983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256] added
Oct 20 14:54:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[812bd504-ec22-4dbb-a61f-885dbdff74c4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef63c4-343f-41ec-9343-f46d9c43a49c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkytXQnM {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkytXQnM" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a71b74-c009-483b-a9be-faebdea041fd]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UkytXQnM'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[43642b31-671c-4bcf-aeb0-8ad6e1507b3a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a0376-b481-4d28-a3d0-815d0b611946]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:54:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:54:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:54:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 14:54:13 user nova-compute[76870]: 
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c895285-114b-46b1-a436-6dd85e374cf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260]
Oct 20 14:54:13 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260] successful.
Oct 20 14:54:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[43215e7e-d359-467f-ad05-bc3db814e7d7]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d0c79f-a7ca-4948-a2cb-873eea60e841]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 (non-flash)
Oct 20 14:54:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 (non-flash)
Oct 20 14:54:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7dba46-98f9-42b2-853e-73fdc77df34c]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:54:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkytXQnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:54:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:54:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23135306263636666', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:54:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135306263636666', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1779625315',display_name='tempest-TestVolumeBootPattern-server-1779625315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1779625315',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-ueri36gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:53:50Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=f5f598b9-68b3-4ed5-9a8d-0267ea556904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'pci_devices' on Instance uuid f5f598b9-68b3-4ed5-9a8d-0267ea556904 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:54:15 user nova-compute[76870]:   <uuid>f5f598b9-68b3-4ed5-9a8d-0267ea556904</uuid>
Oct 20 14:54:15 user nova-compute[76870]:   <name>instance-00000021</name>
Oct 20 14:54:15 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:54:15 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:54:15 user nova-compute[76870]:   <metadata>
Oct 20 14:54:15 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:54:15 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:54:15 user nova-compute[76870]:       <nova:name>tempest-TestVolumeBootPattern-server-1779625315</nova:name>
Oct 20 14:54:15 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:54:13</nova:creationTime>
Oct 20 14:54:15 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:54:15 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:54:15 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:54:15 user nova-compute[76870]:       <nova:owner>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:user uuid="407faf0fe9f44219a2d0580e9819f8ec">tempest-TestVolumeBootPattern-2023237776-project-member</nova:user>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:project uuid="710a95fd9def4ae08263d4cdafbdffd3">tempest-TestVolumeBootPattern-2023237776</nova:project>
Oct 20 14:54:15 user nova-compute[76870]:       </nova:owner>
Oct 20 14:54:15 user nova-compute[76870]:       <nova:ports>
Oct 20 14:54:15 user nova-compute[76870]:         <nova:port uuid="ef8d66c7-0720-4fcf-bc91-050d25751678">
Oct 20 14:54:15 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 14:54:15 user nova-compute[76870]:         </nova:port>
Oct 20 14:54:15 user nova-compute[76870]:       </nova:ports>
Oct 20 14:54:15 user nova-compute[76870]:     </nova:instance>
Oct 20 14:54:15 user nova-compute[76870]:   </metadata>
Oct 20 14:54:15 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:54:15 user nova-compute[76870]:     <system>
Oct 20 14:54:15 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:54:15 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:54:15 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:54:15 user nova-compute[76870]:       <entry name="serial">f5f598b9-68b3-4ed5-9a8d-0267ea556904</entry>
Oct 20 14:54:15 user nova-compute[76870]:       <entry name="uuid">f5f598b9-68b3-4ed5-9a8d-0267ea556904</entry>
Oct 20 14:54:15 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:54:15 user nova-compute[76870]:     </system>
Oct 20 14:54:15 user nova-compute[76870]:   </sysinfo>
Oct 20 14:54:15 user nova-compute[76870]:   <os>
Oct 20 14:54:15 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:54:15 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:54:15 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:54:15 user nova-compute[76870]:   </os>
Oct 20 14:54:15 user nova-compute[76870]:   <features>
Oct 20 14:54:15 user nova-compute[76870]:     <acpi/>
Oct 20 14:54:15 user nova-compute[76870]:     <apic/>
Oct 20 14:54:15 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:54:15 user nova-compute[76870]:   </features>
Oct 20 14:54:15 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:54:15 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:54:15 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:54:15 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:54:15 user nova-compute[76870]:   </clock>
Oct 20 14:54:15 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:54:15 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:54:15 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:54:15 user nova-compute[76870]:   </cpu>
Oct 20 14:54:15 user nova-compute[76870]:   <devices>
Oct 20 14:54:15 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:54:15 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:54:15 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 14:54:15 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:54:15 user nova-compute[76870]:       <serial>5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256</serial>
Oct 20 14:54:15 user nova-compute[76870]:     </disk>
Oct 20 14:54:15 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:54:15 user nova-compute[76870]:       <mac address="fa:16:3e:1a:c1:2b"/>
Oct 20 14:54:15 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:54:15 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:54:15 user nova-compute[76870]:       <target dev="tapef8d66c7-07"/>
Oct 20 14:54:15 user nova-compute[76870]:     </interface>
Oct 20 14:54:15 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:54:15 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/f5f598b9-68b3-4ed5-9a8d-0267ea556904/console.log" append="off"/>
Oct 20 14:54:15 user nova-compute[76870]:     </serial>
Oct 20 14:54:15 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:54:15 user nova-compute[76870]:     <video>
Oct 20 14:54:15 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:54:15 user nova-compute[76870]:     </video>
Oct 20 14:54:15 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:54:15 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:54:15 user nova-compute[76870]:     </rng>
Oct 20 14:54:15 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:54:15 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:54:15 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:54:15 user nova-compute[76870]:     </memballoon>
Oct 20 14:54:15 user nova-compute[76870]:   </devices>
Oct 20 14:54:15 user nova-compute[76870]: </domain>
Oct 20 14:54:15 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1779625315',display_name='tempest-TestVolumeBootPattern-server-1779625315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1779625315',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-ueri36gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:53:50Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=f5f598b9-68b3-4ed5-9a8d-0267ea556904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG os_vif [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33896194-8d48-5f6c-8de3-3fe45411a9d7', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8d66c7-07, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef8d66c7-07, col_values=(('qos', UUID('02d5c9b4-02cf-4d03-ae6c-7774d63b0b2e')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef8d66c7-07, col_values=(('external_ids', {'iface-id': 'ef8d66c7-0720-4fcf-bc91-050d25751678', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:c1:2b', 'vm-uuid': 'f5f598b9-68b3-4ed5-9a8d-0267ea556904'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:15 user nova-compute[76870]: INFO os_vif [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07')
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:54:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No VIF found with MAC fa:16:3e:1a:c1:2b, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-3824610c-b139-44e6-93da-949a85464b4a req-97b95f11-3fb7-4791-bb4d-191500e91471 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3824610c-b139-44e6-93da-949a85464b4a req-97b95f11-3fb7-4791-bb4d-191500e91471 service nova] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3824610c-b139-44e6-93da-949a85464b4a req-97b95f11-3fb7-4791-bb4d-191500e91471 service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3824610c-b139-44e6-93da-949a85464b4a req-97b95f11-3fb7-4791-bb4d-191500e91471 service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-3824610c-b139-44e6-93da-949a85464b4a req-97b95f11-3fb7-4791-bb4d-191500e91471 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] No waiting events found dispatching network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:54:16 user nova-compute[76870]: WARNING nova.compute.manager [req-3824610c-b139-44e6-93da-949a85464b4a req-97b95f11-3fb7-4791-bb4d-191500e91471 service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received unexpected event network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 for instance with vm_state building and task_state spawning.
Oct 20 14:54:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:54:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Instance spawned successfully.
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:18 user nova-compute[76870]: INFO nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Took 5.10 seconds to spawn the instance on the hypervisor.
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-fc36369e-0d1d-4f01-b8cd-69a443be842e req-275c0046-1204-4a2a-9e72-ec27ce52580e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fc36369e-0d1d-4f01-b8cd-69a443be842e req-275c0046-1204-4a2a-9e72-ec27ce52580e service nova] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fc36369e-0d1d-4f01-b8cd-69a443be842e req-275c0046-1204-4a2a-9e72-ec27ce52580e service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fc36369e-0d1d-4f01-b8cd-69a443be842e req-275c0046-1204-4a2a-9e72-ec27ce52580e service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-fc36369e-0d1d-4f01-b8cd-69a443be842e req-275c0046-1204-4a2a-9e72-ec27ce52580e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] No waiting events found dispatching network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:54:18 user nova-compute[76870]: WARNING nova.compute.manager [req-fc36369e-0d1d-4f01-b8cd-69a443be842e req-275c0046-1204-4a2a-9e72-ec27ce52580e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received unexpected event network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 for instance with vm_state building and task_state spawning.
Oct 20 14:54:18 user nova-compute[76870]: INFO nova.compute.manager [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Took 29.48 seconds to build instance.
Oct 20 14:54:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3eba9630-edae-408d-b255-3aeefd16253e tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.644s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:54:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:54:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:54:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:54:27 user nova-compute[76870]: INFO nova.compute.claims [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Claim successful on node user
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:54:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.policy [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdd157499df5446e8c082732e1fbd278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb2d2209f464235949db2d48ec8e2eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:54:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Creating image(s)
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.336s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk 1073741824" returned: 0 in 0.115s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.229s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Successfully created port: cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Cannot resize image /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Ensure instance console log exists: /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Successfully updated port: cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing instance network info cache due to event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:54:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance network_info: |[{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Start _get_guest_xml network_info=[{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:54:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:54:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-769182693',display_name='tempest-ServerRescueNegativeTestJSON-server-769182693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-769182693',id=34,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmwSXYUEx9rW06xk5OHVP9H4NAKV86Uc1mZEe5OgDloTx9OpGHGlxWbyQRrHTV0KLavBACdEuz1vPc4e6gVv4AVUrz8apZuHx1WdzOw5Z5pQFSiZG67ape/agVWm39ucQ==',key_name='tempest-keypair-519323342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-f7q8ucql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdd157499df5446e8c082732e1fbd278',uuid=6f7587fb-f5b3-4b07-b5d7-dead87bbd49d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.objects.instance [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:54:30 user nova-compute[76870]:   <uuid>6f7587fb-f5b3-4b07-b5d7-dead87bbd49d</uuid>
Oct 20 14:54:30 user nova-compute[76870]:   <name>instance-00000022</name>
Oct 20 14:54:30 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:54:30 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:54:30 user nova-compute[76870]:   <metadata>
Oct 20 14:54:30 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:54:30 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:54:30 user nova-compute[76870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-769182693</nova:name>
Oct 20 14:54:30 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:54:30</nova:creationTime>
Oct 20 14:54:30 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:54:30 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:54:30 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:54:30 user nova-compute[76870]:       <nova:owner>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:user uuid="fdd157499df5446e8c082732e1fbd278">tempest-ServerRescueNegativeTestJSON-1475360384-project-member</nova:user>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:project uuid="5bb2d2209f464235949db2d48ec8e2eb">tempest-ServerRescueNegativeTestJSON-1475360384</nova:project>
Oct 20 14:54:30 user nova-compute[76870]:       </nova:owner>
Oct 20 14:54:30 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:54:30 user nova-compute[76870]:       <nova:ports>
Oct 20 14:54:30 user nova-compute[76870]:         <nova:port uuid="cc9c95d3-deb4-493d-b45f-c0c2205d8c46">
Oct 20 14:54:30 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 14:54:30 user nova-compute[76870]:         </nova:port>
Oct 20 14:54:30 user nova-compute[76870]:       </nova:ports>
Oct 20 14:54:30 user nova-compute[76870]:     </nova:instance>
Oct 20 14:54:30 user nova-compute[76870]:   </metadata>
Oct 20 14:54:30 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:54:30 user nova-compute[76870]:     <system>
Oct 20 14:54:30 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:54:30 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:54:30 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:54:30 user nova-compute[76870]:       <entry name="serial">6f7587fb-f5b3-4b07-b5d7-dead87bbd49d</entry>
Oct 20 14:54:30 user nova-compute[76870]:       <entry name="uuid">6f7587fb-f5b3-4b07-b5d7-dead87bbd49d</entry>
Oct 20 14:54:30 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:54:30 user nova-compute[76870]:     </system>
Oct 20 14:54:30 user nova-compute[76870]:   </sysinfo>
Oct 20 14:54:30 user nova-compute[76870]:   <os>
Oct 20 14:54:30 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:54:30 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:54:30 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:54:30 user nova-compute[76870]:   </os>
Oct 20 14:54:30 user nova-compute[76870]:   <features>
Oct 20 14:54:30 user nova-compute[76870]:     <acpi/>
Oct 20 14:54:30 user nova-compute[76870]:     <apic/>
Oct 20 14:54:30 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:54:30 user nova-compute[76870]:   </features>
Oct 20 14:54:30 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:54:30 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:54:30 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:54:30 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:54:30 user nova-compute[76870]:   </clock>
Oct 20 14:54:30 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:54:30 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:54:30 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:54:30 user nova-compute[76870]:   </cpu>
Oct 20 14:54:30 user nova-compute[76870]:   <devices>
Oct 20 14:54:30 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:54:30 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:54:30 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk"/>
Oct 20 14:54:30 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:54:30 user nova-compute[76870]:     </disk>
Oct 20 14:54:30 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:54:30 user nova-compute[76870]:       <mac address="fa:16:3e:1d:73:4a"/>
Oct 20 14:54:30 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:54:30 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:54:30 user nova-compute[76870]:       <target dev="tapcc9c95d3-de"/>
Oct 20 14:54:30 user nova-compute[76870]:     </interface>
Oct 20 14:54:30 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:54:30 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/console.log" append="off"/>
Oct 20 14:54:30 user nova-compute[76870]:     </serial>
Oct 20 14:54:30 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:54:30 user nova-compute[76870]:     <video>
Oct 20 14:54:30 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:54:30 user nova-compute[76870]:     </video>
Oct 20 14:54:30 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:54:30 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:54:30 user nova-compute[76870]:     </rng>
Oct 20 14:54:30 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:54:30 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:54:30 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:54:30 user nova-compute[76870]:     </memballoon>
Oct 20 14:54:30 user nova-compute[76870]:   </devices>
Oct 20 14:54:30 user nova-compute[76870]: </domain>
Oct 20 14:54:30 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-769182693',display_name='tempest-ServerRescueNegativeTestJSON-server-769182693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-769182693',id=34,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmwSXYUEx9rW06xk5OHVP9H4NAKV86Uc1mZEe5OgDloTx9OpGHGlxWbyQRrHTV0KLavBACdEuz1vPc4e6gVv4AVUrz8apZuHx1WdzOw5Z5pQFSiZG67ape/agVWm39ucQ==',key_name='tempest-keypair-519323342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-f7q8ucql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdd157499df5446e8c082732e1fbd278',uuid=6f7587fb-f5b3-4b07-b5d7-dead87bbd49d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG os_vif [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c5c788f-9283-55b7-9b00-5eae10d32080', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc9c95d3-de, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc9c95d3-de, col_values=(('qos', UUID('3dbb5bd5-d4a7-4eaf-975e-dda23b742647')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc9c95d3-de, col_values=(('external_ids', {'iface-id': 'cc9c95d3-deb4-493d-b45f-c0c2205d8c46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:73:4a', 'vm-uuid': '6f7587fb-f5b3-4b07-b5d7-dead87bbd49d'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:30 user nova-compute[76870]: INFO os_vif [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de')
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:1d:73:4a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updated VIF entry in instance network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:54:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a2f42c0-8746-457b-b38b-5f31ca737ea3 req-bb97c22e-2f8a-4e18-9401-9b9b1965654d service nova] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-096b4008-8312-4d59-91d8-832b5e3591be req-2e300269-d271-48b2-9633-f163ac41a116 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-096b4008-8312-4d59-91d8-832b5e3591be req-2e300269-d271-48b2-9633-f163ac41a116 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-096b4008-8312-4d59-91d8-832b5e3591be req-2e300269-d271-48b2-9633-f163ac41a116 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-096b4008-8312-4d59-91d8-832b5e3591be req-2e300269-d271-48b2-9633-f163ac41a116 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-096b4008-8312-4d59-91d8-832b5e3591be req-2e300269-d271-48b2-9633-f163ac41a116 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:54:31 user nova-compute[76870]: WARNING nova.compute.manager [req-096b4008-8312-4d59-91d8-832b5e3591be req-2e300269-d271-48b2-9633-f163ac41a116 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state building and task_state spawning.
Oct 20 14:54:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-3aee2c03-a213-41ef-9856-aa04340ccb87 req-b98494af-81d2-4d24-a445-035a994bbc1c service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3aee2c03-a213-41ef-9856-aa04340ccb87 req-b98494af-81d2-4d24-a445-035a994bbc1c service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3aee2c03-a213-41ef-9856-aa04340ccb87 req-b98494af-81d2-4d24-a445-035a994bbc1c service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3aee2c03-a213-41ef-9856-aa04340ccb87 req-b98494af-81d2-4d24-a445-035a994bbc1c service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-3aee2c03-a213-41ef-9856-aa04340ccb87 req-b98494af-81d2-4d24-a445-035a994bbc1c service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:54:33 user nova-compute[76870]: WARNING nova.compute.manager [req-3aee2c03-a213-41ef-9856-aa04340ccb87 req-b98494af-81d2-4d24-a445-035a994bbc1c service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state building and task_state spawning.
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:54:33 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance spawned successfully.
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:54:34 user nova-compute[76870]: INFO nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 20 14:54:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:54:34 user nova-compute[76870]: INFO nova.compute.manager [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Took 7.20 seconds to build instance.
Oct 20 14:54:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-25f762ca-4cf2-4e09-9e1e-13a90cfd7aee tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.309s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:54:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:54:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:54:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:54:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:54:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8242MB free_disk=25.13241195678711GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance f5f598b9-68b3-4ed5-9a8d-0267ea556904 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:54:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:54:52 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:54:53 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:54:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:54:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:54:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:54:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:55:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:55:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:55:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:55:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:55:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:55:28 user nova-compute[76870]: INFO nova.compute.claims [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Claim successful on node user
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:55:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:55:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Creating image(s)
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "/opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "/opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "/opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG nova.policy [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92a6a66a0ef4d5bb5a3c35db785fed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f630fc424cf49c7a2cd3881538e51c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk 1073741824" returned: 0 in 0.046s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Cannot resize image /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Ensure instance console log exists: /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Successfully created port: a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:55:29 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Successfully updated port: a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquired lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-changed-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Refreshing instance network info cache due to event network-changed-a2639df6-f7d8-4e1f-8f98-5f9ba4474138. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] Acquiring lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.neutron [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updating instance_info_cache with network_info: [{"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Releasing lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Instance network_info: |[{"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] Acquired lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Refreshing network info cache for port a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Start _get_guest_xml network_info=[{"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:55:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:55:30 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-111108377',display_name='tempest-VolumesSnapshotTestJSON-instance-111108377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-111108377',id=35,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH56G47+a9fdCmVvMjwwK/qoybIL6naMFbxEkv1S+kWXg4XBFiY3uj/tog9+1ymjLKwDpEfLWNnd/gpT1hqyeGQbFPL07MbLEnvcxntQSNkMzfM9FOJ9YlaxjDkyLinhdg==',key_name='tempest-keypair-634166194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f630fc424cf49c7a2cd3881538e51c2',ramdisk_id='',reservation_id='r-zg5fu9y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-380444352',owner_user_name='tempest-VolumesSnapshotTestJSON-380444352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92a6a66a0ef4d5bb5a3c35db785fed7',uuid=a780b4af-69a3-4d2b-abfc-db081b38c807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converting VIF {"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.objects.instance [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'pci_devices' on Instance uuid a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:55:30 user nova-compute[76870]:   <uuid>a780b4af-69a3-4d2b-abfc-db081b38c807</uuid>
Oct 20 14:55:30 user nova-compute[76870]:   <name>instance-00000023</name>
Oct 20 14:55:30 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:55:30 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:55:30 user nova-compute[76870]:   <metadata>
Oct 20 14:55:30 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:55:30 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:55:30 user nova-compute[76870]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-111108377</nova:name>
Oct 20 14:55:30 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:55:30</nova:creationTime>
Oct 20 14:55:30 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:55:30 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:55:30 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:55:30 user nova-compute[76870]:       <nova:owner>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:user uuid="b92a6a66a0ef4d5bb5a3c35db785fed7">tempest-VolumesSnapshotTestJSON-380444352-project-member</nova:user>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:project uuid="2f630fc424cf49c7a2cd3881538e51c2">tempest-VolumesSnapshotTestJSON-380444352</nova:project>
Oct 20 14:55:30 user nova-compute[76870]:       </nova:owner>
Oct 20 14:55:30 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:55:30 user nova-compute[76870]:       <nova:ports>
Oct 20 14:55:30 user nova-compute[76870]:         <nova:port uuid="a2639df6-f7d8-4e1f-8f98-5f9ba4474138">
Oct 20 14:55:30 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 14:55:30 user nova-compute[76870]:         </nova:port>
Oct 20 14:55:30 user nova-compute[76870]:       </nova:ports>
Oct 20 14:55:30 user nova-compute[76870]:     </nova:instance>
Oct 20 14:55:30 user nova-compute[76870]:   </metadata>
Oct 20 14:55:30 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:55:30 user nova-compute[76870]:     <system>
Oct 20 14:55:30 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:55:30 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:55:30 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:55:30 user nova-compute[76870]:       <entry name="serial">a780b4af-69a3-4d2b-abfc-db081b38c807</entry>
Oct 20 14:55:30 user nova-compute[76870]:       <entry name="uuid">a780b4af-69a3-4d2b-abfc-db081b38c807</entry>
Oct 20 14:55:30 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:55:30 user nova-compute[76870]:     </system>
Oct 20 14:55:30 user nova-compute[76870]:   </sysinfo>
Oct 20 14:55:30 user nova-compute[76870]:   <os>
Oct 20 14:55:30 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:55:30 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:55:30 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:55:30 user nova-compute[76870]:   </os>
Oct 20 14:55:30 user nova-compute[76870]:   <features>
Oct 20 14:55:30 user nova-compute[76870]:     <acpi/>
Oct 20 14:55:30 user nova-compute[76870]:     <apic/>
Oct 20 14:55:30 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:55:30 user nova-compute[76870]:   </features>
Oct 20 14:55:30 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:55:30 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:55:30 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:55:30 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:55:30 user nova-compute[76870]:   </clock>
Oct 20 14:55:30 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:55:30 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:55:30 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:55:30 user nova-compute[76870]:   </cpu>
Oct 20 14:55:30 user nova-compute[76870]:   <devices>
Oct 20 14:55:30 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:55:30 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:55:30 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk"/>
Oct 20 14:55:30 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:55:30 user nova-compute[76870]:     </disk>
Oct 20 14:55:30 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:55:30 user nova-compute[76870]:       <mac address="fa:16:3e:b5:a8:2c"/>
Oct 20 14:55:30 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:55:30 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:55:30 user nova-compute[76870]:       <target dev="tapa2639df6-f7"/>
Oct 20 14:55:30 user nova-compute[76870]:     </interface>
Oct 20 14:55:30 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:55:30 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/console.log" append="off"/>
Oct 20 14:55:30 user nova-compute[76870]:     </serial>
Oct 20 14:55:30 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:55:30 user nova-compute[76870]:     <video>
Oct 20 14:55:30 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:55:30 user nova-compute[76870]:     </video>
Oct 20 14:55:30 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:55:30 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:55:30 user nova-compute[76870]:     </rng>
Oct 20 14:55:30 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:55:30 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:55:30 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:55:30 user nova-compute[76870]:     </memballoon>
Oct 20 14:55:30 user nova-compute[76870]:   </devices>
Oct 20 14:55:30 user nova-compute[76870]: </domain>
Oct 20 14:55:30 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-111108377',display_name='tempest-VolumesSnapshotTestJSON-instance-111108377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-111108377',id=35,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH56G47+a9fdCmVvMjwwK/qoybIL6naMFbxEkv1S+kWXg4XBFiY3uj/tog9+1ymjLKwDpEfLWNnd/gpT1hqyeGQbFPL07MbLEnvcxntQSNkMzfM9FOJ9YlaxjDkyLinhdg==',key_name='tempest-keypair-634166194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f630fc424cf49c7a2cd3881538e51c2',ramdisk_id='',reservation_id='r-zg5fu9y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-380444352',owner_user_name='tempest-VolumesSnapshotTestJSON-380444352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92a6a66a0ef4d5bb5a3c35db785fed7',uuid=a780b4af-69a3-4d2b-abfc-db081b38c807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converting VIF {"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG os_vif [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81302357-03f1-5cca-a27c-d2cc568bd1c2', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2639df6-f7, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2639df6-f7, col_values=(('qos', UUID('aff12ad0-78cd-4b90-8e91-e1dd774171fa')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2639df6-f7, col_values=(('external_ids', {'iface-id': 'a2639df6-f7d8-4e1f-8f98-5f9ba4474138', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:a8:2c', 'vm-uuid': 'a780b4af-69a3-4d2b-abfc-db081b38c807'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:30 user nova-compute[76870]: INFO os_vif [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7')
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No VIF found with MAC fa:16:3e:b5:a8:2c, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updated VIF entry in instance network info cache for port a2639df6-f7d8-4e1f-8f98-5f9ba4474138. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG nova.network.neutron [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updating instance_info_cache with network_info: [{"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:55:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3b8c3292-5b2b-45a2-adc0-032b7bef7221 req-9687bd44-b83f-4067-898a-92cc2c3414ee service nova] Releasing lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-b72457c6-1e26-497a-bb54-e73c5ad6a3bb req-d2a3e6b0-c25d-4641-8abb-c891f6a0152d service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b72457c6-1e26-497a-bb54-e73c5ad6a3bb req-d2a3e6b0-c25d-4641-8abb-c891f6a0152d service nova] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b72457c6-1e26-497a-bb54-e73c5ad6a3bb req-d2a3e6b0-c25d-4641-8abb-c891f6a0152d service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b72457c6-1e26-497a-bb54-e73c5ad6a3bb req-d2a3e6b0-c25d-4641-8abb-c891f6a0152d service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:31 user nova-compute[76870]: DEBUG nova.compute.manager [req-b72457c6-1e26-497a-bb54-e73c5ad6a3bb req-d2a3e6b0-c25d-4641-8abb-c891f6a0152d service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] No waiting events found dispatching network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:55:31 user nova-compute[76870]: WARNING nova.compute.manager [req-b72457c6-1e26-497a-bb54-e73c5ad6a3bb req-d2a3e6b0-c25d-4641-8abb-c891f6a0152d service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received unexpected event network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 for instance with vm_state building and task_state spawning.
Oct 20 14:55:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:55:33 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Instance spawned successfully.
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:55:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:55:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-5ecf0d91-940d-44c2-aceb-4c137037c41f req-acd216b0-1ad7-45c0-8920-f43c016b6979 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5ecf0d91-940d-44c2-aceb-4c137037c41f req-acd216b0-1ad7-45c0-8920-f43c016b6979 service nova] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5ecf0d91-940d-44c2-aceb-4c137037c41f req-acd216b0-1ad7-45c0-8920-f43c016b6979 service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5ecf0d91-940d-44c2-aceb-4c137037c41f req-acd216b0-1ad7-45c0-8920-f43c016b6979 service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-5ecf0d91-940d-44c2-aceb-4c137037c41f req-acd216b0-1ad7-45c0-8920-f43c016b6979 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] No waiting events found dispatching network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:55:34 user nova-compute[76870]: WARNING nova.compute.manager [req-5ecf0d91-940d-44c2-aceb-4c137037c41f req-acd216b0-1ad7-45c0-8920-f43c016b6979 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received unexpected event network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 for instance with vm_state building and task_state spawning.
Oct 20 14:55:34 user nova-compute[76870]: INFO nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 14:55:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:55:34 user nova-compute[76870]: INFO nova.compute.manager [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Took 6.13 seconds to build instance.
Oct 20 14:55:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2fb31909-b19d-4c1b-ad35-6c2e1f910cce tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.239s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:39 user nova-compute[76870]: INFO nova.compute.manager [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Terminating instance
Oct 20 14:55:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-238d442d-bc6a-4791-9bfb-c04c381e6532 req-a03235cb-dd11-42d1-851e-2c3e90a4889f service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-vif-unplugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-238d442d-bc6a-4791-9bfb-c04c381e6532 req-a03235cb-dd11-42d1-851e-2c3e90a4889f service nova] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-238d442d-bc6a-4791-9bfb-c04c381e6532 req-a03235cb-dd11-42d1-851e-2c3e90a4889f service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-238d442d-bc6a-4791-9bfb-c04c381e6532 req-a03235cb-dd11-42d1-851e-2c3e90a4889f service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-238d442d-bc6a-4791-9bfb-c04c381e6532 req-a03235cb-dd11-42d1-851e-2c3e90a4889f service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] No waiting events found dispatching network-vif-unplugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-238d442d-bc6a-4791-9bfb-c04c381e6532 req-a03235cb-dd11-42d1-851e-2c3e90a4889f service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-vif-unplugged-ef8d66c7-0720-4fcf-bc91-050d25751678 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Instance destroyed successfully.
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.objects.instance [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'resources' on Instance uuid f5f598b9-68b3-4ed5-9a8d-0267ea556904 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1779625315',display_name='tempest-TestVolumeBootPattern-server-1779625315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1779625315',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:54:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-ueri36gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:54:19Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=f5f598b9-68b3-4ed5-9a8d-0267ea556904,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "ef8d66c7-0720-4fcf-bc91-050d25751678", "address": "fa:16:3e:1a:c1:2b", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8d66c7-07", "ovs_interfaceid": "ef8d66c7-0720-4fcf-bc91-050d25751678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_vif [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8d66c7-07, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02d5c9b4-02cf-4d03-ae6c-7774d63b0b2e) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:55:40 user nova-compute[76870]: INFO os_vif [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c1:2b,bridge_name='br-int',has_traffic_filtering=True,id=ef8d66c7-0720-4fcf-bc91-050d25751678,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8d66c7-07')
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkytXQnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:55:40 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a97d810-c6c3-45a1-b769-4179f8bbd8fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:55:40 user nova-compute[76870]: No targets found.
Oct 20 14:55:40 user nova-compute[76870]: iSNS:
Oct 20 14:55:40 user nova-compute[76870]: No targets found.
Oct 20 14:55:40 user nova-compute[76870]: STATIC:
Oct 20 14:55:40 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256
Oct 20 14:55:40 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:55:40 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:55:40 user nova-compute[76870]: FIRMWARE:
Oct 20 14:55:40 user nova-compute[76870]: No targets found.
Oct 20 14:55:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:55:40 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:55:40 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614d768-2b0c-45e6-a32b-b1f3b2ef0d42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c476b98-e705-4a96-95e0-9b2016efcec5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 (non-flash)
Oct 20 14:55:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 (non-flash)
Oct 20 14:55:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c3beef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91367fef-b81c-4425-bff5-d6a020342dd5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[649df1b6-06df-456f-b0b4-871e9dd3e4de]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279ba7a-8930-4755-bf51-3ed044cb4340]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaca465-845d-44f6-bc90-db71b0181cd5]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f259a490', '/dev/disk/by-id/scsi-1SCST_BIOf259a490-150bccffbf536169', '/dev/disk/by-id/scsi-23135306263636666') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f829fb9d-b7cc-45b9-ab13-54e4cf1bd138]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[393dfd70-abb1-4f8e-8f48-9e5d384cd9d2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19014c5-3f1b-4664-886c-ad1c2101d828]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260]
Oct 20 14:55:40 user nova-compute[76870]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256, portal: 172.16.0.220,3260] successful.
Oct 20 14:55:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fb455e-d720-4363-8b62-5459ecc308d4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== disconnect_volume: return (315ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:55:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Deleting instance files /opt/stack/data/nova/instances/f5f598b9-68b3-4ed5-9a8d-0267ea556904_del
Oct 20 14:55:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Deletion of /opt/stack/data/nova/instances/f5f598b9-68b3-4ed5-9a8d-0267ea556904_del complete
Oct 20 14:55:40 user nova-compute[76870]: INFO nova.compute.manager [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 20 14:55:40 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:55:40 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:55:41 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:55:41 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Took 0.44 seconds to deallocate network for instance.
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] Acquiring lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] No waiting events found dispatching network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:55:42 user nova-compute[76870]: WARNING nova.compute.manager [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received unexpected event network-vif-plugged-ef8d66c7-0720-4fcf-bc91-050d25751678 for instance with vm_state active and task_state deleting.
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-aeafe421-6541-4ab0-8ad9-bc9908cf25d6 req-6eb69c39-d2ae-46f5-9ab6-d5f7bce7638e service nova] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Received event network-vif-deleted-ef8d66c7-0720-4fcf-bc91-050d25751678 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:42 user nova-compute[76870]: INFO nova.compute.manager [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Took 0.78 seconds to detach 1 volumes for instance.
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: f5f598b9-68b3-4ed5-9a8d-0267ea556904] Deleting volume: 5fc7bc9b-3c83-4374-9cd2-1c5d4ac95256 {{(pid=76870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:42 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Deleted allocations for instance f5f598b9-68b3-4ed5-9a8d-0267ea556904
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-da00df54-6c34-4c83-bc5c-1e79e308619f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "f5f598b9-68b3-4ed5-9a8d-0267ea556904" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.866s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:55:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:47 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:48 user nova-compute[76870]: INFO nova.compute.manager [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Terminating instance
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] During wait destroy, instance disappeared. {{(pid=76870) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Oct 20 14:55:48 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Instance destroyed successfully.
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.objects.instance [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'resources' on Instance uuid 663ff166-5934-49b0-bb00-4600c1c31b08 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T14:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1239079696',display_name='tempest-ServerActionsTestOtherA-server-33169401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1239079696',id=11,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtWduLiSPzp/VIWUKHUa6UtA2knbF4Q50olmDaUXr/g/hom82515E7C8B1Pp5lBk6XIf+Ts5MHmM2RjJ9FLsPEJfZPdRT6D+WICkm8NU+kt+pvIZmBiyTVuZYgnHIt+pg==',key_name='tempest-keypair-115946927',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-tas7lovi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=663ff166-5934-49b0-bb00-4600c1c31b08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "address": "fa:16:3e:47:0d:93", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa013c6d2-9a", "ovs_interfaceid": "a013c6d2-9a71-4087-be3d-e3f42d0ee608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG os_vif [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa013c6d2-9a, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:55:48 user nova-compute[76870]: INFO os_vif [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:0d:93,bridge_name='br-int',has_traffic_filtering=True,id=a013c6d2-9a71-4087-be3d-e3f42d0ee608,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa013c6d2-9a')
Oct 20 14:55:48 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:61b55d67-ffb9-4238-bea4-ed3129730953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VepuGQwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:55:48 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:55:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ce251669-35ce-4be1-ad6f-a75bb16036fc]: Unexpected error while running command.
Oct 20 14:55:48 user nova-compute[76870]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 14:55:48 user nova-compute[76870]: Exit code: 21
Oct 20 14:55:48 user nova-compute[76870]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 14:55:48 user nova-compute[76870]: Stderr: '' {{(pid=87639) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 14:55:48 user nova-compute[76870]: Traceback (most recent call last):
Oct 20 14:55:48 user nova-compute[76870]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 14:55:48 user nova-compute[76870]:     ret = func(*f_args, **f_kwargs)
Oct 20 14:55:48 user nova-compute[76870]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 14:55:48 user nova-compute[76870]:     return func(*args, **kwargs)
Oct 20 14:55:48 user nova-compute[76870]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 14:55:48 user nova-compute[76870]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 14:55:48 user nova-compute[76870]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 14:55:48 user nova-compute[76870]:     return putils.execute(on_execute=on_execute,
Oct 20 14:55:48 user nova-compute[76870]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 14:55:48 user nova-compute[76870]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 14:55:48 user nova-compute[76870]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 14:55:48 user nova-compute[76870]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 14:55:48 user nova-compute[76870]: Exit code: 21
Oct 20 14:55:48 user nova-compute[76870]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 14:55:48 user nova-compute[76870]: Stderr: ''
Oct 20 14:55:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce251669-35ce-4be1-ad6f-a75bb16036fc]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 14:55:48 user nova-compute[76870]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 14:55:48 user nova-compute[76870]: Exit code: 21
Oct 20 14:55:48 user nova-compute[76870]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 14:55:48 user nova-compute[76870]: Stderr: ''
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 14:55:48 user nova-compute[76870]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 14:55:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=76870) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== disconnect_volume: return (31ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:55:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Deletion of /opt/stack/data/nova/instances/663ff166-5934-49b0-bb00-4600c1c31b08_del complete
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:49 user nova-compute[76870]: INFO nova.compute.manager [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Took 0.18 seconds to destroy the instance on the hypervisor.
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-a22ed51b-418b-42ee-b477-b7da2c0b028c req-df9c570d-3376-4946-a175-a7a9cd47e848 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Received event network-vif-deleted-a013c6d2-9a71-4087-be3d-e3f42d0ee608 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:55:49 user nova-compute[76870]: INFO nova.compute.manager [req-a22ed51b-418b-42ee-b477-b7da2c0b028c req-df9c570d-3376-4946-a175-a7a9cd47e848 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Neutron deleted interface a013c6d2-9a71-4087-be3d-e3f42d0ee608; detaching it from the instance and deleting it from the info cache
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.network.neutron [req-a22ed51b-418b-42ee-b477-b7da2c0b028c req-df9c570d-3376-4946-a175-a7a9cd47e848 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:55:49 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Took 0.86 seconds to deallocate network for instance.
Oct 20 14:55:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-a22ed51b-418b-42ee-b477-b7da2c0b028c req-df9c570d-3376-4946-a175-a7a9cd47e848 service nova] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Detach interface failed, port_id=a013c6d2-9a71-4087-be3d-e3f42d0ee608, reason: Instance 663ff166-5934-49b0-bb00-4600c1c31b08 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:55:50 user nova-compute[76870]: INFO nova.compute.manager [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: 663ff166-5934-49b0-bb00-4600c1c31b08] Took 0.08 seconds to detach 1 volumes for instance.
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-fb8933cf-5ee4-47a0-bd55-9d005f3ea5da tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "663ff166-5934-49b0-bb00-4600c1c31b08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.595s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:55:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:55:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8333MB free_disk=25.101150512695312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a780b4af-69a3-4d2b-abfc-db081b38c807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:55:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:55:52 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:55:52 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:55:52 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:55:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:55:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:55 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:55:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:55:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:55:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:55:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing instance network info cache due to event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.objects.instance [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'flavor' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:18 user nova-compute[76870]: INFO nova.compute.manager [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Attaching volume d7b141be-cbac-4015-8673-3ef128a2e1ee to /dev/vdb
Oct 20 14:56:18 user nova-compute[76870]: DEBUG os_brick.utils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updated VIF entry in instance network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a61e8d-0901-4e7e-b507-d51d4451f667]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-eff35b64-acf0-49c2-b8fd-3ff41b6a36a4 req-f3f9fbb6-b46f-4ae2-ba6d-96a7146466f9 service nova] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc469f15-b510-459e-9520-e8cc4bd8f21f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab900fa-a839-4334-b422-39a8f013555c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82404a45-17b2-4904-ae3b-065541708156]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:56:18 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:56:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7946944-df93-4b47-95e7-f076f62c6896]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG os_brick.utils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:56:18 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating existing volume attachment record: 8a20a52a-32fe-4b5f-bb23-6259568455e2 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:56:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCpRZhIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:56:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:56:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:56:34 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c857f058-8f16-4c8d-ae56-3e7cfaf26d43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:56:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4983aa7-d0bf-4b4a-90d6-e011810a219d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee] added
Oct 20 14:56:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[196bde1d-7ca5-49ed-b19f-3c845b1640bc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b833ae41-2ad8-49ce-835a-375578406a6a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCpRZhIu {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCpRZhIu" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef0201-9835-4b27-a72a-45380cd6a0aa]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCpRZhIu'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b3d3de-29f4-4c51-90ae-c80a4d93c663]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bacbdff-0af4-4609-8cc2-84973bff3869]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:56:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 14:56:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:56:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 14:56:34 user nova-compute[76870]: 
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ec580-b8ce-43bc-8197-1dc9440357dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260]
Oct 20 14:56:34 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260] successful.
Oct 20 14:56:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4693235-1c7d-4996-8464-6c7a8c08b17e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c5ec3a-2ea3-4033-9aee-b8be2fc4b6ba]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:56:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:56:35 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb843e56-429a-4c7f-93b8-48ff21f44380]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCpRZhIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:56:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26363353238343330', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363353238343330', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG nova.objects.instance [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'flavor' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:56:36 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:56:36 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 14:56:36 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:56:36 user nova-compute[76870]:   <serial>d7b141be-cbac-4015-8673-3ef128a2e1ee</serial>
Oct 20 14:56:36 user nova-compute[76870]: </disk>
Oct 20 14:56:36 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:1d:73:4a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:56:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5e027ca5-7771-455e-96c4-ed43b70b4787 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.340s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:37 user nova-compute[76870]: INFO nova.compute.manager [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Rescuing
Oct 20 14:56:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc200d39-ee8c-44b1-a3f7-c5ef7fbf893e req-38766c95-f648-4531-a058-76a670d2ef76 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc200d39-ee8c-44b1-a3f7-c5ef7fbf893e req-38766c95-f648-4531-a058-76a670d2ef76 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc200d39-ee8c-44b1-a3f7-c5ef7fbf893e req-38766c95-f648-4531-a058-76a670d2ef76 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc200d39-ee8c-44b1-a3f7-c5ef7fbf893e req-38766c95-f648-4531-a058-76a670d2ef76 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc200d39-ee8c-44b1-a3f7-c5ef7fbf893e req-38766c95-f648-4531-a058-76a670d2ef76 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:56:37 user nova-compute[76870]: WARNING nova.compute.manager [req-dc200d39-ee8c-44b1-a3f7-c5ef7fbf893e req-38766c95-f648-4531-a058-76a670d2ef76 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state active and task_state rescuing.
Oct 20 14:56:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance destroyed successfully.
Oct 20 14:56:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Attempting rescue
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 14:56:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Creating image(s)
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue" returned: 0 in 0.049s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'migration_context' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.base [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<6f7587fb-f5b3-4b07-b5d7-dead87bbd49d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Start _get_guest_xml network_info=[{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:1d:73:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'resources' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.base [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<6f7587fb-f5b3-4b07-b5d7-dead87bbd49d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.base [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<6f7587fb-f5b3-4b07-b5d7-dead87bbd49d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:56:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:56:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.base [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<6f7587fb-f5b3-4b07-b5d7-dead87bbd49d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-769182693',display_name='tempest-ServerRescueNegativeTestJSON-server-769182693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-769182693',id=34,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmwSXYUEx9rW06xk5OHVP9H4NAKV86Uc1mZEe5OgDloTx9OpGHGlxWbyQRrHTV0KLavBACdEuz1vPc4e6gVv4AVUrz8apZuHx1WdzOw5Z5pQFSiZG67ape/agVWm39ucQ==',key_name='tempest-keypair-519323342',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-f7q8ucql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdd157499df5446e8c082732e1fbd278',uuid=6f7587fb-f5b3-4b07-b5d7-dead87bbd49d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:1d:73:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "vif_mac": "fa:16:3e:1d:73:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.instance [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.objects.base [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Object Instance<6f7587fb-f5b3-4b07-b5d7-dead87bbd49d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:56:38 user nova-compute[76870]:   <uuid>6f7587fb-f5b3-4b07-b5d7-dead87bbd49d</uuid>
Oct 20 14:56:38 user nova-compute[76870]:   <name>instance-00000022</name>
Oct 20 14:56:38 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:56:38 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:56:38 user nova-compute[76870]:   <metadata>
Oct 20 14:56:38 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:56:38 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:56:38 user nova-compute[76870]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-769182693</nova:name>
Oct 20 14:56:38 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:56:38</nova:creationTime>
Oct 20 14:56:38 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:56:38 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:56:38 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:56:38 user nova-compute[76870]:       <nova:owner>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:user uuid="fdd157499df5446e8c082732e1fbd278">tempest-ServerRescueNegativeTestJSON-1475360384-project-member</nova:user>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:project uuid="5bb2d2209f464235949db2d48ec8e2eb">tempest-ServerRescueNegativeTestJSON-1475360384</nova:project>
Oct 20 14:56:38 user nova-compute[76870]:       </nova:owner>
Oct 20 14:56:38 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 14:56:38 user nova-compute[76870]:       <nova:ports>
Oct 20 14:56:38 user nova-compute[76870]:         <nova:port uuid="cc9c95d3-deb4-493d-b45f-c0c2205d8c46">
Oct 20 14:56:38 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 14:56:38 user nova-compute[76870]:         </nova:port>
Oct 20 14:56:38 user nova-compute[76870]:       </nova:ports>
Oct 20 14:56:38 user nova-compute[76870]:     </nova:instance>
Oct 20 14:56:38 user nova-compute[76870]:   </metadata>
Oct 20 14:56:38 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:56:38 user nova-compute[76870]:     <system>
Oct 20 14:56:38 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:56:38 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:56:38 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:56:38 user nova-compute[76870]:       <entry name="serial">6f7587fb-f5b3-4b07-b5d7-dead87bbd49d</entry>
Oct 20 14:56:38 user nova-compute[76870]:       <entry name="uuid">6f7587fb-f5b3-4b07-b5d7-dead87bbd49d</entry>
Oct 20 14:56:38 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:56:38 user nova-compute[76870]:     </system>
Oct 20 14:56:38 user nova-compute[76870]:   </sysinfo>
Oct 20 14:56:38 user nova-compute[76870]:   <os>
Oct 20 14:56:38 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:56:38 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:56:38 user nova-compute[76870]:   </os>
Oct 20 14:56:38 user nova-compute[76870]:   <features>
Oct 20 14:56:38 user nova-compute[76870]:     <acpi/>
Oct 20 14:56:38 user nova-compute[76870]:     <apic/>
Oct 20 14:56:38 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:56:38 user nova-compute[76870]:   </features>
Oct 20 14:56:38 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:56:38 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:56:38 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:56:38 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:56:38 user nova-compute[76870]:   </clock>
Oct 20 14:56:38 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:56:38 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:56:38 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:56:38 user nova-compute[76870]:   </cpu>
Oct 20 14:56:38 user nova-compute[76870]:   <devices>
Oct 20 14:56:38 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:56:38 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:56:38 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue"/>
Oct 20 14:56:38 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:56:38 user nova-compute[76870]:     </disk>
Oct 20 14:56:38 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 14:56:38 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 14:56:38 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk"/>
Oct 20 14:56:38 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 14:56:38 user nova-compute[76870]:     </disk>
Oct 20 14:56:38 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:56:38 user nova-compute[76870]:       <mac address="fa:16:3e:1d:73:4a"/>
Oct 20 14:56:38 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:56:38 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:56:38 user nova-compute[76870]:       <target dev="tapcc9c95d3-de"/>
Oct 20 14:56:38 user nova-compute[76870]:     </interface>
Oct 20 14:56:38 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:56:38 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/console.log" append="off"/>
Oct 20 14:56:38 user nova-compute[76870]:     </serial>
Oct 20 14:56:38 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:56:38 user nova-compute[76870]:     <video>
Oct 20 14:56:38 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:56:38 user nova-compute[76870]:     </video>
Oct 20 14:56:38 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:56:38 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:56:38 user nova-compute[76870]:     </rng>
Oct 20 14:56:38 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:56:38 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:56:38 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:56:38 user nova-compute[76870]:     </memballoon>
Oct 20 14:56:38 user nova-compute[76870]:   </devices>
Oct 20 14:56:38 user nova-compute[76870]: </domain>
Oct 20 14:56:38 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:56:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance destroyed successfully.
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:56:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] No VIF found with MAC fa:16:3e:1d:73:4a, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:56:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-2e920796-fd4d-43fc-96b7-7cf1f62ca768 req-25a029f4-b7ce-4920-a087-54933f2a27e9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:56:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2e920796-fd4d-43fc-96b7-7cf1f62ca768 req-25a029f4-b7ce-4920-a087-54933f2a27e9 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2e920796-fd4d-43fc-96b7-7cf1f62ca768 req-25a029f4-b7ce-4920-a087-54933f2a27e9 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2e920796-fd4d-43fc-96b7-7cf1f62ca768 req-25a029f4-b7ce-4920-a087-54933f2a27e9 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-2e920796-fd4d-43fc-96b7-7cf1f62ca768 req-25a029f4-b7ce-4920-a087-54933f2a27e9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:56:39 user nova-compute[76870]: WARNING nova.compute.manager [req-2e920796-fd4d-43fc-96b7-7cf1f62ca768 req-25a029f4-b7ce-4920-a087-54933f2a27e9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state active and task_state rescuing.
Oct 20 14:56:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:56:41 user nova-compute[76870]: WARNING nova.compute.manager [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state active and task_state rescuing.
Oct 20 14:56:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:56:41 user nova-compute[76870]: WARNING nova.compute.manager [req-58628a5b-5c52-4a52-b49f-adf69477c5a1 req-e1904605-3cce-465c-828a-73ac69cd2ac2 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state active and task_state rescuing.
Oct 20 14:56:42 user nova-compute[76870]: DEBUG nova.compute.manager [None req-07db55d0-63c4-4cfa-894e-798dbcf29159 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:56:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:56:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:56:49 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:56:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:56:51 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8375MB free_disk=25.095706939697266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a780b4af-69a3-4d2b-abfc-db081b38c807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 14:56:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 14:56:52 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:56:52 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:56:52 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:56:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "0ef00916-b444-490b-a221-81f18276baaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "0ef00916-b444-490b-a221-81f18276baaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 14:56:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 4 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 14:56:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Deletion of /opt/stack/data/nova/instances/a734d0c6-9dff-4254-9231-040de2c5eacc_resize failed
Oct 20 14:56:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:56:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:56:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:56:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 14:56:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 14:57:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:05 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:57:05 user nova-compute[76870]: INFO nova.compute.claims [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Claim successful on node user
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:57:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.policy [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '407faf0fe9f44219a2d0580e9819f8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710a95fd9def4ae08263d4cdafbdffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:57:06 user nova-compute[76870]: INFO nova.virt.block_device [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Booting with volume 2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 at /dev/vda
Oct 20 14:57:06 user nova-compute[76870]: DEBUG os_brick.utils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec3804-b9db-41f2-ba31-fde76c52657d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[60436ed3-a1c8-4673-8b2e-5444b3dc1fe3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb767e42-6ddd-4045-8457-dbdf5f88934d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3186a34-1969-45a8-b263-21ef6708efa2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:57:06 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:57:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a044d-a36b-45fc-81da-18b69fe5ae52]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG os_brick.utils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:57:06 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating existing volume attachment record: 22472ffd-ecb4-498a-8a49-b6eae270ff0c {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:57:07 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Successfully created port: 98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:57:07 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Successfully updated port: 98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:57:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:57:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquired lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:57:07 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-changed-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Refreshing instance network info cache due to event network-changed-98255487-c8b3-4c47-ae06-6ee3b9a0acd8. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] Acquiring lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating instance_info_cache with network_info: [{"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Releasing lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Instance network_info: |[{"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] Acquired lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.network.neutron [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Refreshing network info cache for port 98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.network.neutron [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updated VIF entry in instance network info cache for port 98255487-c8b3-4c47-ae06-6ee3b9a0acd8. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG nova.network.neutron [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating instance_info_cache with network_info: [{"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:57:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6e961ac0-6f94-4bb4-9ada-827372d6dcea req-71c5b315-c788-4d61-9ece-fca30bf75f42 service nova] Releasing lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:57:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-changed-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:57:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Refreshing instance network info cache due to event network-changed-a2639df6-f7d8-4e1f-8f98-5f9ba4474138. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:57:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] Acquiring lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:57:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] Acquired lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:57:18 user nova-compute[76870]: DEBUG nova.network.neutron [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Refreshing network info cache for port a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'flavor' on Instance uuid a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:57:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Ignoring supplied device name: /dev/vdb
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG nova.network.neutron [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updated VIF entry in instance network info cache for port a2639df6-f7d8-4e1f-8f98-5f9ba4474138. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG nova.network.neutron [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updating instance_info_cache with network_info: [{"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-62021f8d-2387-47e6-8bd4-0b6178b7c5a0 req-91d04132-b996-487b-b59c-34d6b4ae826e service nova] Releasing lock "refresh_cache-a780b4af-69a3-4d2b-abfc-db081b38c807" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:19 user nova-compute[76870]: INFO nova.compute.manager [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Attaching volume 5da1d442-0768-47db-b3cf-9f9b26d1ea7b to /dev/vdb
Oct 20 14:57:19 user nova-compute[76870]: DEBUG os_brick.utils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[42815697-c866-4101-a0cc-9439f0f09817]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9956d-f037-4f6e-80e4-c0cfca48f1e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b2293-ea76-4c68-9318-f80ae6a69620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9d79c1-3b81-47a1-9818-6974885ecf88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:57:19 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:57:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e065fd0e-4203-4940-a37b-ee901ba88b2c]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG os_brick.utils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updating existing volume attachment record: ccdb31c0-3c0c-4d83-87e1-7296494cfeb8 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:57:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTuzefUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:57:38 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:57:38 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:57:38 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d12aa7f-223a-4db6-b2f2-c2efe574751f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:57:38 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c891b2d2-6f90-43a8-97ff-fd2efb3b558f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b] added
Oct 20 14:57:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d595ef-ebc1-4878-9771-8ec447892b52]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1530c9da-f780-4403-9460-ccd516246810]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTuzefUN {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTuzefUN" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda94d4-65e4-4657-8861-c633b5a2335b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tTuzefUN'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f418f8-e471-4058-bc72-75be078b5b6a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:57:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Creating image(s)
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Ensure instance console log exists: /opt/stack/data/nova/instances/c1b032b7-20ca-49f7-9f5f-ce0632256594/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Start _get_guest_xml network_info=[{"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '22472ffd-ecb4-498a-8a49-b6eae270ff0c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfAxqWZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1b032b7-20ca-49f7-9f5f-ce0632256594', 'attached_at': '', 'detached_at': '', 'volume_id': '2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6', 'serial': '2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8342cc6b-bb44-4d0a-96ae-6f15e7777a95]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:57:38 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfAxqWZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:57:38 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92917a90-c46d-4ec0-8a75-495d1285ec41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260]
Oct 20 14:57:38 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260] successful.
Oct 20 14:57:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370242f-ebab-468d-8242-3e637468fd4d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[518561dd-3c97-4cef-b040-9dddc3e161da]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:38 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:57:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:38 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:57:38 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eefe74-88ce-464b-8efc-e85a65ff99c1]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:57:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTuzefUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23738643139653662', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738643139653662', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.085s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:57:39 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:57:39 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'flavor' on Instance uuid a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03f692d-cbed-4fbb-b91d-2308d643cfb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:57:39 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 14:57:39 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:57:39 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:57:39 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:57:39 user nova-compute[76870]:   <serial>5da1d442-0768-47db-b3cf-9f9b26d1ea7b</serial>
Oct 20 14:57:39 user nova-compute[76870]: </disk>
Oct 20 14:57:39 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d497e-2bd9-45d4-b853-aed2a43d219f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6] added
Oct 20 14:57:39 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cdfa10-3655-4fce-997b-8f110959d5da]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f350c0c0-24e3-4c58-b0ec-6eef628614a0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfAxqWZS {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfAxqWZS" returned: 0 in 0.027s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49f073-b415-46d5-8d32-89a84496de29]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mfAxqWZS'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee8637-126a-414f-a08c-b09ba668ef94]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bac4e0-c980-4247-80b1-a94b60837cad]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:40 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:57:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:40 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:57:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f048022-ce25-490f-9739-0d1f4c4fb987]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260]
Oct 20 14:57:40 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260] successful.
Oct 20 14:57:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4104dc4b-88e5-4f4c-81fe-c73857b3d285]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f302364-adb1-4e27-85c8-f91565e27776]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:40 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:57:40 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:57:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:57:40 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:57:40 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:57:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e1b5fc-8a14-4785-a0f3-1f1cdc54e964]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfAxqWZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No VIF found with MAC fa:16:3e:b5:a8:2c, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4c3ffbe-668c-4715-8809-84f1cd70f9c7 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.078s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:57:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== connect_volume: return (2408ms) {'type': 'block', 'scsi_wwn': '23036343539336138', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036343539336138', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-572892426',display_name='tempest-TestVolumeBootPattern-volume-backed-server-572892426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-572892426',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1xcTtVho5Fcra54xRFIbsHTfmtN3hbQaDymM/ymWEn5BcuoT1+x3RGY+vv/h7hA6IhCZEBTIUYUpMqskOYOq30ZokVKX5APZhyW+WuDJt9Z6BmPiURg1uWG5/gusunDg==',key_name='tempest-keypair-2139144007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-1004m700',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=c1b032b7-20ca-49f7-9f5f-ce0632256594,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'pci_devices' on Instance uuid c1b032b7-20ca-49f7-9f5f-ce0632256594 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:57:41 user nova-compute[76870]:   <uuid>c1b032b7-20ca-49f7-9f5f-ce0632256594</uuid>
Oct 20 14:57:41 user nova-compute[76870]:   <name>instance-00000024</name>
Oct 20 14:57:41 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:57:41 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:57:41 user nova-compute[76870]:   <metadata>
Oct 20 14:57:41 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:57:41 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:57:41 user nova-compute[76870]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-572892426</nova:name>
Oct 20 14:57:41 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:57:38</nova:creationTime>
Oct 20 14:57:41 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:57:41 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:57:41 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:57:41 user nova-compute[76870]:       <nova:owner>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:user uuid="407faf0fe9f44219a2d0580e9819f8ec">tempest-TestVolumeBootPattern-2023237776-project-member</nova:user>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:project uuid="710a95fd9def4ae08263d4cdafbdffd3">tempest-TestVolumeBootPattern-2023237776</nova:project>
Oct 20 14:57:41 user nova-compute[76870]:       </nova:owner>
Oct 20 14:57:41 user nova-compute[76870]:       <nova:ports>
Oct 20 14:57:41 user nova-compute[76870]:         <nova:port uuid="98255487-c8b3-4c47-ae06-6ee3b9a0acd8">
Oct 20 14:57:41 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 14:57:41 user nova-compute[76870]:         </nova:port>
Oct 20 14:57:41 user nova-compute[76870]:       </nova:ports>
Oct 20 14:57:41 user nova-compute[76870]:     </nova:instance>
Oct 20 14:57:41 user nova-compute[76870]:   </metadata>
Oct 20 14:57:41 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:57:41 user nova-compute[76870]:     <system>
Oct 20 14:57:41 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:57:41 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:57:41 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:57:41 user nova-compute[76870]:       <entry name="serial">c1b032b7-20ca-49f7-9f5f-ce0632256594</entry>
Oct 20 14:57:41 user nova-compute[76870]:       <entry name="uuid">c1b032b7-20ca-49f7-9f5f-ce0632256594</entry>
Oct 20 14:57:41 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:57:41 user nova-compute[76870]:     </system>
Oct 20 14:57:41 user nova-compute[76870]:   </sysinfo>
Oct 20 14:57:41 user nova-compute[76870]:   <os>
Oct 20 14:57:41 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:57:41 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:57:41 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:57:41 user nova-compute[76870]:   </os>
Oct 20 14:57:41 user nova-compute[76870]:   <features>
Oct 20 14:57:41 user nova-compute[76870]:     <acpi/>
Oct 20 14:57:41 user nova-compute[76870]:     <apic/>
Oct 20 14:57:41 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:57:41 user nova-compute[76870]:   </features>
Oct 20 14:57:41 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:57:41 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:57:41 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:57:41 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:57:41 user nova-compute[76870]:   </clock>
Oct 20 14:57:41 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:57:41 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:57:41 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:57:41 user nova-compute[76870]:   </cpu>
Oct 20 14:57:41 user nova-compute[76870]:   <devices>
Oct 20 14:57:41 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:57:41 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:57:41 user nova-compute[76870]:       <source dev="/dev/sdd"/>
Oct 20 14:57:41 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:57:41 user nova-compute[76870]:       <serial>2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6</serial>
Oct 20 14:57:41 user nova-compute[76870]:     </disk>
Oct 20 14:57:41 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:57:41 user nova-compute[76870]:       <mac address="fa:16:3e:b1:27:64"/>
Oct 20 14:57:41 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:57:41 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:57:41 user nova-compute[76870]:       <target dev="tap98255487-c8"/>
Oct 20 14:57:41 user nova-compute[76870]:     </interface>
Oct 20 14:57:41 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:57:41 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c1b032b7-20ca-49f7-9f5f-ce0632256594/console.log" append="off"/>
Oct 20 14:57:41 user nova-compute[76870]:     </serial>
Oct 20 14:57:41 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:57:41 user nova-compute[76870]:     <video>
Oct 20 14:57:41 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:57:41 user nova-compute[76870]:     </video>
Oct 20 14:57:41 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:57:41 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:57:41 user nova-compute[76870]:     </rng>
Oct 20 14:57:41 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:57:41 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:57:41 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:57:41 user nova-compute[76870]:     </memballoon>
Oct 20 14:57:41 user nova-compute[76870]:   </devices>
Oct 20 14:57:41 user nova-compute[76870]: </domain>
Oct 20 14:57:41 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-572892426',display_name='tempest-TestVolumeBootPattern-volume-backed-server-572892426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-572892426',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1xcTtVho5Fcra54xRFIbsHTfmtN3hbQaDymM/ymWEn5BcuoT1+x3RGY+vv/h7hA6IhCZEBTIUYUpMqskOYOq30ZokVKX5APZhyW+WuDJt9Z6BmPiURg1uWG5/gusunDg==',key_name='tempest-keypair-2139144007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-1004m700',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=c1b032b7-20ca-49f7-9f5f-ce0632256594,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG os_vif [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2f065e0-699a-5097-b09c-61104dad1a19', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98255487-c8, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98255487-c8, col_values=(('qos', UUID('f0a2db97-55a6-49a7-a2e8-13421d667c6e')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98255487-c8, col_values=(('external_ids', {'iface-id': '98255487-c8b3-4c47-ae06-6ee3b9a0acd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:27:64', 'vm-uuid': 'c1b032b7-20ca-49f7-9f5f-ce0632256594'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:41 user nova-compute[76870]: INFO os_vif [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8')
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:57:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No VIF found with MAC fa:16:3e:b1:27:64, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-dd102d3a-79f2-4fca-b340-60f1e37cbe26 req-2abb0f21-641e-4358-a5ad-38de07dedd27 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dd102d3a-79f2-4fca-b340-60f1e37cbe26 req-2abb0f21-641e-4358-a5ad-38de07dedd27 service nova] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dd102d3a-79f2-4fca-b340-60f1e37cbe26 req-2abb0f21-641e-4358-a5ad-38de07dedd27 service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dd102d3a-79f2-4fca-b340-60f1e37cbe26 req-2abb0f21-641e-4358-a5ad-38de07dedd27 service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-dd102d3a-79f2-4fca-b340-60f1e37cbe26 req-2abb0f21-641e-4358-a5ad-38de07dedd27 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] No waiting events found dispatching network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:57:42 user nova-compute[76870]: WARNING nova.compute.manager [req-dd102d3a-79f2-4fca-b340-60f1e37cbe26 req-2abb0f21-641e-4358-a5ad-38de07dedd27 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received unexpected event network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 for instance with vm_state building and task_state spawning.
Oct 20 14:57:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:57:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Instance spawned successfully.
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:57:44 user nova-compute[76870]: INFO nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:44 user nova-compute[76870]: INFO nova.compute.manager [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Took 39.09 seconds to build instance.
Oct 20 14:57:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7733459a-13ab-42a0-93fb-7870f87a7d2c tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.179s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ba83ccb-16e4-4d29-bb3a-06215adc27a3 req-732fde9e-204a-4f1d-a5aa-4ade2f43f01f service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ba83ccb-16e4-4d29-bb3a-06215adc27a3 req-732fde9e-204a-4f1d-a5aa-4ade2f43f01f service nova] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ba83ccb-16e4-4d29-bb3a-06215adc27a3 req-732fde9e-204a-4f1d-a5aa-4ade2f43f01f service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ba83ccb-16e4-4d29-bb3a-06215adc27a3 req-732fde9e-204a-4f1d-a5aa-4ade2f43f01f service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ba83ccb-16e4-4d29-bb3a-06215adc27a3 req-732fde9e-204a-4f1d-a5aa-4ade2f43f01f service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] No waiting events found dispatching network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:57:44 user nova-compute[76870]: WARNING nova.compute.manager [req-9ba83ccb-16e4-4d29-bb3a-06215adc27a3 req-732fde9e-204a-4f1d-a5aa-4ade2f43f01f service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received unexpected event network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 for instance with vm_state active and task_state None.
Oct 20 14:57:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:57:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:49 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:57:50 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:57:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:57:53 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:57:53 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=25.09276580810547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a780b4af-69a3-4d2b-abfc-db081b38c807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c1b032b7-20ca-49f7-9f5f-ce0632256594 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:57:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:57:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:57:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:57:57 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:57:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:57:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:57:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:57:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:58:23 user nova-compute[76870]: INFO nova.compute.claims [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Claim successful on node user
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:58:23 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.policy [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e65eb07d084dcb9e5e9188961f4b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8ea9d998b4ba587b16fec8b792c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:58:23 user nova-compute[76870]: INFO nova.virt.block_device [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Booting with volume a56bdb25-c021-4456-8852-5d580d153a1c at /dev/vda
Oct 20 14:58:23 user nova-compute[76870]: DEBUG os_brick.utils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0b1aca-017c-4973-a7f8-cbcd3d5bd4cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1ef5c-609e-428e-85cb-f750cbc6dd00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d51889-f3f3-4833-b481-65e179835235]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf532fec-a3c3-42fa-a028-64ea3a3e6944]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:58:23 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:58:23 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6da5f1-3cba-4c38-ac99-0721ad462ab7]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG os_brick.utils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:58:23 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating existing volume attachment record: d1374302-c5d8-4c2e-856b-06e3d9136a8c {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:58:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:24 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Successfully created port: 1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Successfully updated port: 1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-changed-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Refreshing instance network info cache due to event network-changed-1752f9e4-bac7-4948-934b-27899ad99c04. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance network_info: |[{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:58:25 user nova-compute[76870]: DEBUG nova.network.neutron [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Refreshing network info cache for port 1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:58:26 user nova-compute[76870]: DEBUG nova.network.neutron [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updated VIF entry in instance network info cache for port 1752f9e4-bac7-4948-934b-27899ad99c04. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:58:26 user nova-compute[76870]: DEBUG nova.network.neutron [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:58:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6d25aed9-8051-4175-b776-95a284a56e7b req-8d204bfc-a054-453d-8359-3d73d2fddb33 service nova] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:58:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:27 user nova-compute[76870]: INFO nova.compute.manager [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Unrescuing
Oct 20 14:58:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:58:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:58:27 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG nova.network.neutron [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'flavor' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-dd5b3148-c08b-4ce7-b238-80bba0572245 req-848c9744-3440-4ad7-a181-55916097961f service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dd5b3148-c08b-4ce7-b238-80bba0572245 req-848c9744-3440-4ad7-a181-55916097961f service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dd5b3148-c08b-4ce7-b238-80bba0572245 req-848c9744-3440-4ad7-a181-55916097961f service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dd5b3148-c08b-4ce7-b238-80bba0572245 req-848c9744-3440-4ad7-a181-55916097961f service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-dd5b3148-c08b-4ce7-b238-80bba0572245 req-848c9744-3440-4ad7-a181-55916097961f service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:58:28 user nova-compute[76870]: WARNING nova.compute.manager [req-dd5b3148-c08b-4ce7-b238-80bba0572245 req-848c9744-3440-4ad7-a181-55916097961f service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:58:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:29 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance destroyed successfully.
Oct 20 14:58:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:58:30 user nova-compute[76870]: WARNING nova.compute.manager [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:58:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:58:30 user nova-compute[76870]: WARNING nova.compute.manager [req-1cd10ada-8611-4693-a707-f2bc3fe0bd5e req-f989653e-d454-41e3-8285-3e9af4f3e1a8 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:58:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-7d942340-0901-42d6-8956-26b3d4ba74b3 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:58:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-7f021e05-0fd8-406d-a9e5-57299097b248 req-9674050a-4068-4410-9302-e510e558f7c9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:58:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7f021e05-0fd8-406d-a9e5-57299097b248 req-9674050a-4068-4410-9302-e510e558f7c9 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7f021e05-0fd8-406d-a9e5-57299097b248 req-9674050a-4068-4410-9302-e510e558f7c9 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7f021e05-0fd8-406d-a9e5-57299097b248 req-9674050a-4068-4410-9302-e510e558f7c9 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-7f021e05-0fd8-406d-a9e5-57299097b248 req-9674050a-4068-4410-9302-e510e558f7c9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:58:32 user nova-compute[76870]: WARNING nova.compute.manager [req-7f021e05-0fd8-406d-a9e5-57299097b248 req-9674050a-4068-4410-9302-e510e558f7c9 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state rescued and task_state unrescuing.
Oct 20 14:58:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:58:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:58:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:58:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:58:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:58:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:58:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:58:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:58:55 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:58:55 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8244MB free_disk=25.075084686279297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a780b4af-69a3-4d2b-abfc-db081b38c807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c1b032b7-20ca-49f7-9f5f-ce0632256594 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:58:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:58:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:58:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-changed-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:58:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Refreshing instance network info cache due to event network-changed-98255487-c8b3-4c47-ae06-6ee3b9a0acd8. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:58:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] Acquiring lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:58:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] Acquired lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:58:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Refreshing network info cache for port 98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:58:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updated VIF entry in instance network info cache for port 98255487-c8b3-4c47-ae06-6ee3b9a0acd8. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:58:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating instance_info_cache with network_info: [{"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:58:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-40eeb897-4933-4cfc-9770-9e4c8a00a13f req-e9b5d256-2c0a-4e7d-813e-f73647a544e1 service nova] Releasing lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:58:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [{"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-0ef00916-b444-490b-a221-81f18276baaa" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:58:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:59:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Creating image(s)
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Ensure instance console log exists: /opt/stack/data/nova/instances/c575033f-89b0-4e8e-a827-50c8ab260713/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Start _get_guest_xml network_info=[{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd1374302-c5d8-4c2e-856b-06e3d9136a8c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c575033f-89b0-4e8e-a827-50c8ab260713', 'attached_at': '', 'detached_at': '', 'volume_id': 'a56bdb25-c021-4456-8852-5d580d153a1c', 'serial': 'a56bdb25-c021-4456-8852-5d580d153a1c'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:59:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:59:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:59:04 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:59:04 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:59:04 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec195486-8266-4764-bdae-65caa574f377]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:59:04 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b3f4d-b191-4cbf-a3a7-49df2d2fcdeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c] added
Oct 20 14:59:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48faa3f-745e-44c3-89d2-3f4f89e0c35b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4709f3fe-9f55-4e12-9e7f-3d7cb4037937]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQhbuNBE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQhbuNBE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e21740-f016-40e3-9f88-6f8efe9b398c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQhbuNBE'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.177s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f508d-7daf-4130-b4f7-f9a9ce9c01a3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86ed988-794d-4936-a2e4-6aa03a03a9c7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:05 user nova-compute[76870]: INFO nova.compute.manager [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Detaching volume 5da1d442-0768-47db-b3cf-9f9b26d1ea7b
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba72f01-6ed0-47a6-a0bf-26429006672d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]
Oct 20 14:59:05 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.
Oct 20 14:59:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0fcb54-24ca-406d-b830-b6644cc5949b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:05 user nova-compute[76870]: INFO nova.virt.block_device [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Attempting to driver detach volume 5da1d442-0768-47db-b3cf-9f9b26d1ea7b from mountpoint /dev/vdb
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c12a56-a1e4-4403-9a55-a6a0087a816e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:05 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Attempting to detach device vdb from instance a780b4af-69a3-4d2b-abfc-db081b38c807 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:59:05 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:59:05 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:59:05 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:59:05 user nova-compute[76870]:   <serial>5da1d442-0768-47db-b3cf-9f9b26d1ea7b</serial>
Oct 20 14:59:05 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:59:05 user nova-compute[76870]: </disk>
Oct 20 14:59:05 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:59:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully detached device vdb from instance a780b4af-69a3-4d2b-abfc-db081b38c807 from the persistent domain config.
Oct 20 14:59:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a780b4af-69a3-4d2b-abfc-db081b38c807 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 14:59:05 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:59:05 user nova-compute[76870]:   <source dev="/dev/sdc"/>
Oct 20 14:59:05 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 14:59:05 user nova-compute[76870]:   <serial>5da1d442-0768-47db-b3cf-9f9b26d1ea7b</serial>
Oct 20 14:59:05 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 14:59:05 user nova-compute[76870]: </disk>
Oct 20 14:59:05 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b778a0-de8c-4db6-81c9-dc4a5b5c9364]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:59:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23034303665383563', 'path': '/dev/sde'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034303665383563', 'path': '/dev/sde'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-932890794',display_name='tempest-ServerActionsTestOtherA-server-932890794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-932890794',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-yatnb2fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c575033f-89b0-4e8e-a827-50c8ab260713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'pci_devices' on Instance uuid c575033f-89b0-4e8e-a827-50c8ab260713 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:59:06 user nova-compute[76870]:   <uuid>c575033f-89b0-4e8e-a827-50c8ab260713</uuid>
Oct 20 14:59:06 user nova-compute[76870]:   <name>instance-00000025</name>
Oct 20 14:59:06 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:59:06 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:59:06 user nova-compute[76870]:   <metadata>
Oct 20 14:59:06 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:59:06 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:59:06 user nova-compute[76870]:       <nova:name>tempest-ServerActionsTestOtherA-server-932890794</nova:name>
Oct 20 14:59:06 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:59:04</nova:creationTime>
Oct 20 14:59:06 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:59:06 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:59:06 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:59:06 user nova-compute[76870]:       <nova:owner>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:user uuid="91e65eb07d084dcb9e5e9188961f4b44">tempest-ServerActionsTestOtherA-404958601-project-member</nova:user>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:project uuid="94c8ea9d998b4ba587b16fec8b792c13">tempest-ServerActionsTestOtherA-404958601</nova:project>
Oct 20 14:59:06 user nova-compute[76870]:       </nova:owner>
Oct 20 14:59:06 user nova-compute[76870]:       <nova:ports>
Oct 20 14:59:06 user nova-compute[76870]:         <nova:port uuid="1752f9e4-bac7-4948-934b-27899ad99c04">
Oct 20 14:59:06 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 14:59:06 user nova-compute[76870]:         </nova:port>
Oct 20 14:59:06 user nova-compute[76870]:       </nova:ports>
Oct 20 14:59:06 user nova-compute[76870]:     </nova:instance>
Oct 20 14:59:06 user nova-compute[76870]:   </metadata>
Oct 20 14:59:06 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:59:06 user nova-compute[76870]:     <system>
Oct 20 14:59:06 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:59:06 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:59:06 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:59:06 user nova-compute[76870]:       <entry name="serial">c575033f-89b0-4e8e-a827-50c8ab260713</entry>
Oct 20 14:59:06 user nova-compute[76870]:       <entry name="uuid">c575033f-89b0-4e8e-a827-50c8ab260713</entry>
Oct 20 14:59:06 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:59:06 user nova-compute[76870]:     </system>
Oct 20 14:59:06 user nova-compute[76870]:   </sysinfo>
Oct 20 14:59:06 user nova-compute[76870]:   <os>
Oct 20 14:59:06 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:59:06 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:59:06 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:59:06 user nova-compute[76870]:   </os>
Oct 20 14:59:06 user nova-compute[76870]:   <features>
Oct 20 14:59:06 user nova-compute[76870]:     <acpi/>
Oct 20 14:59:06 user nova-compute[76870]:     <apic/>
Oct 20 14:59:06 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:59:06 user nova-compute[76870]:   </features>
Oct 20 14:59:06 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:59:06 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:59:06 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:59:06 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:59:06 user nova-compute[76870]:   </clock>
Oct 20 14:59:06 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:59:06 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:59:06 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:59:06 user nova-compute[76870]:   </cpu>
Oct 20 14:59:06 user nova-compute[76870]:   <devices>
Oct 20 14:59:06 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:59:06 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:59:06 user nova-compute[76870]:       <source dev="/dev/sde"/>
Oct 20 14:59:06 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:59:06 user nova-compute[76870]:       <serial>a56bdb25-c021-4456-8852-5d580d153a1c</serial>
Oct 20 14:59:06 user nova-compute[76870]:     </disk>
Oct 20 14:59:06 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:59:06 user nova-compute[76870]:       <mac address="fa:16:3e:91:96:17"/>
Oct 20 14:59:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:59:06 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:59:06 user nova-compute[76870]:       <target dev="tap1752f9e4-ba"/>
Oct 20 14:59:06 user nova-compute[76870]:     </interface>
Oct 20 14:59:06 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:59:06 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c575033f-89b0-4e8e-a827-50c8ab260713/console.log" append="off"/>
Oct 20 14:59:06 user nova-compute[76870]:     </serial>
Oct 20 14:59:06 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:59:06 user nova-compute[76870]:     <video>
Oct 20 14:59:06 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:59:06 user nova-compute[76870]:     </video>
Oct 20 14:59:06 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:59:06 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:59:06 user nova-compute[76870]:     </rng>
Oct 20 14:59:06 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:59:06 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:59:06 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:59:06 user nova-compute[76870]:     </memballoon>
Oct 20 14:59:06 user nova-compute[76870]:   </devices>
Oct 20 14:59:06 user nova-compute[76870]: </domain>
Oct 20 14:59:06 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-932890794',display_name='tempest-ServerActionsTestOtherA-server-932890794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-932890794',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-yatnb2fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c575033f-89b0-4e8e-a827-50c8ab260713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG os_vif [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44594d17-7836-5c86-93be-ff3792c5f5e8', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1752f9e4-ba, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1752f9e4-ba, col_values=(('qos', UUID('3919fe6b-1bf4-44a1-9a9d-f3e8e2c9e4aa')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1752f9e4-ba, col_values=(('external_ids', {'iface-id': '1752f9e4-bac7-4948-934b-27899ad99c04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:96:17', 'vm-uuid': 'c575033f-89b0-4e8e-a827-50c8ab260713'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:06 user nova-compute[76870]: INFO os_vif [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba')
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:59:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No VIF found with MAC fa:16:3e:91:96:17, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-09ba5e0b-182d-4474-8a0e-b5afaf49d655 req-439878b0-1118-41f1-98ae-cb44de2d36a7 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-09ba5e0b-182d-4474-8a0e-b5afaf49d655 req-439878b0-1118-41f1-98ae-cb44de2d36a7 service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-09ba5e0b-182d-4474-8a0e-b5afaf49d655 req-439878b0-1118-41f1-98ae-cb44de2d36a7 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-09ba5e0b-182d-4474-8a0e-b5afaf49d655 req-439878b0-1118-41f1-98ae-cb44de2d36a7 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-09ba5e0b-182d-4474-8a0e-b5afaf49d655 req-439878b0-1118-41f1-98ae-cb44de2d36a7 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:59:07 user nova-compute[76870]: WARNING nova.compute.manager [req-09ba5e0b-182d-4474-8a0e-b5afaf49d655 req-439878b0-1118-41f1-98ae-cb44de2d36a7 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state building and task_state spawning.
Oct 20 14:59:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:59:09 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance spawned successfully.
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 14:59:09 user nova-compute[76870]: INFO nova.compute.claims [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Claim successful on node user
Oct 20 14:59:09 user nova-compute[76870]: INFO nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-d0b75728-b161-4af1-9ee0-bba3a954ab8b req-36eed659-bcef-422d-b4c7-b8925cb58acb service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d0b75728-b161-4af1-9ee0-bba3a954ab8b req-36eed659-bcef-422d-b4c7-b8925cb58acb service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d0b75728-b161-4af1-9ee0-bba3a954ab8b req-36eed659-bcef-422d-b4c7-b8925cb58acb service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d0b75728-b161-4af1-9ee0-bba3a954ab8b req-36eed659-bcef-422d-b4c7-b8925cb58acb service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-d0b75728-b161-4af1-9ee0-bba3a954ab8b req-36eed659-bcef-422d-b4c7-b8925cb58acb service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:59:09 user nova-compute[76870]: WARNING nova.compute.manager [req-d0b75728-b161-4af1-9ee0-bba3a954ab8b req-36eed659-bcef-422d-b4c7-b8925cb58acb service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state building and task_state spawning.
Oct 20 14:59:09 user nova-compute[76870]: INFO nova.compute.manager [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Took 46.75 seconds to build instance.
Oct 20 14:59:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcb3a902-265f-4db7-ad4c-6468c8a345c4 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.846s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:59:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 14:59:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 14:59:10 user nova-compute[76870]: INFO nova.virt.block_device [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Booting with volume snapshot c2830f1c-7979-49d2-a7a2-8035bff8bc10 at /dev/vda
Oct 20 14:59:10 user nova-compute[76870]: DEBUG nova.policy [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '407faf0fe9f44219a2d0580e9819f8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710a95fd9def4ae08263d4cdafbdffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Successfully created port: 8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Successfully updated port: 8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquired lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-changed-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Refreshing instance network info cache due to event network-changed-8da6a17f-3d65-49a6-b17d-576bd6320f22. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] Acquiring lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updating instance_info_cache with network_info: [{"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Releasing lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Instance network_info: |[{"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 14:59:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] Acquired lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:59:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Refreshing network info cache for port 8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 14:59:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updated VIF entry in instance network info cache for port 8da6a17f-3d65-49a6-b17d-576bd6320f22. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 14:59:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updating instance_info_cache with network_info: [{"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:59:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-cce50113-12e7-42c5-a521-ab4d3ee1dbb1 req-63985dad-ff0c-4920-bdde-05c09fae4949 service nova] Releasing lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:59:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG os_brick.utils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d133e05-5d69-4e77-85e2-4c5d39c87e35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0df83-8d43-4d39-82f7-1b6ebc592593]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6da29-cf80-42aa-9d06-8726264ffe66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b10a83-62b9-4cb2-936d-d288766d74d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 14:59:16 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 14:59:16 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acbf108-8614-4855-b311-23fdcdc4ffde]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG os_brick.utils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:59:16 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updating existing volume attachment record: 8e1913a0-f8e9-44b4-89da-e2204ff1e4d2 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 14:59:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:25 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a780b4af-69a3-4d2b-abfc-db081b38c807 is timed out.
Oct 20 14:59:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully detached device vdb from instance a780b4af-69a3-4d2b-abfc-db081b38c807 from the live domain config.
Oct 20 14:59:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTuzefUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:59:25 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9653728-3882-44ac-9584-a48778d71ef4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:59:25 user nova-compute[76870]: No targets found.
Oct 20 14:59:25 user nova-compute[76870]: iSNS:
Oct 20 14:59:25 user nova-compute[76870]: No targets found.
Oct 20 14:59:25 user nova-compute[76870]: STATIC:
Oct 20 14:59:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 14:59:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6
Oct 20 14:59:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee
Oct 20 14:59:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:25 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b
Oct 20 14:59:25 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:25 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:25 user nova-compute[76870]: FIRMWARE:
Oct 20 14:59:25 user nova-compute[76870]: No targets found.
Oct 20 14:59:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:59:25 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:59:25 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c75c5-c0b4-42d1-99b5-ab06a214a03b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06d3776-fd9a-4b29-968e-5fe17b05a91c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:25 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:59:25 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:25 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:25 user nova-compute[76870]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b (non-flash)
Oct 20 14:59:25 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:25 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:25 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c3bc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[476723c6-2e2d-4065-90c0-783042b422d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[35165616-7d62-4414-a217-39ad6356dc8d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e9681-bdc2-49b7-b85f-51d94db40630]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1591ae58-d789-4d4b-90fa-69c313f1dbac]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac81ee-647c-496c-96b5-c2941f326715]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fc240-6409-4e41-af3a-f5bfdb4a2188]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260]
Oct 20 14:59:26 user nova-compute[76870]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b, portal: 172.16.0.220,3260] successful.
Oct 20 14:59:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[994b5a85-973b-49bf-a065-961bb281393c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== disconnect_volume: return (364ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'flavor' on Instance uuid a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b0e1a449-6875-4493-a96b-6b873dc9c6d5 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.761s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:27 user nova-compute[76870]: INFO nova.compute.manager [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Terminating instance
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-5d120880-219b-4f8f-8490-7398d8e30e8f req-8962fd7c-ddef-4929-b845-cd1e131423b5 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-vif-unplugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5d120880-219b-4f8f-8490-7398d8e30e8f req-8962fd7c-ddef-4929-b845-cd1e131423b5 service nova] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5d120880-219b-4f8f-8490-7398d8e30e8f req-8962fd7c-ddef-4929-b845-cd1e131423b5 service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5d120880-219b-4f8f-8490-7398d8e30e8f req-8962fd7c-ddef-4929-b845-cd1e131423b5 service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-5d120880-219b-4f8f-8490-7398d8e30e8f req-8962fd7c-ddef-4929-b845-cd1e131423b5 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] No waiting events found dispatching network-vif-unplugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-5d120880-219b-4f8f-8490-7398d8e30e8f req-8962fd7c-ddef-4929-b845-cd1e131423b5 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-vif-unplugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 14:59:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Instance destroyed successfully.
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.objects.instance [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'resources' on Instance uuid a780b4af-69a3-4d2b-abfc-db081b38c807 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-111108377',display_name='tempest-VolumesSnapshotTestJSON-instance-111108377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-111108377',id=35,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH56G47+a9fdCmVvMjwwK/qoybIL6naMFbxEkv1S+kWXg4XBFiY3uj/tog9+1ymjLKwDpEfLWNnd/gpT1hqyeGQbFPL07MbLEnvcxntQSNkMzfM9FOJ9YlaxjDkyLinhdg==',key_name='tempest-keypair-634166194',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f630fc424cf49c7a2cd3881538e51c2',ramdisk_id='',reservation_id='r-zg5fu9y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-380444352',owner_user_name='tempest-VolumesSnapshotTestJSON-380444352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:55:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92a6a66a0ef4d5bb5a3c35db785fed7',uuid=a780b4af-69a3-4d2b-abfc-db081b38c807,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converting VIF {"id": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "address": "fa:16:3e:b5:a8:2c", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2639df6-f7", "ovs_interfaceid": "a2639df6-f7d8-4e1f-8f98-5f9ba4474138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_vif [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2639df6-f7, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aff12ad0-78cd-4b90-8e91-e1dd774171fa) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:27 user nova-compute[76870]: INFO os_vif [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a8:2c,bridge_name='br-int',has_traffic_filtering=True,id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2639df6-f7')
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTuzefUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:59:27 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9842154e-72bc-4184-ad4f-4eab63c4eb4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 14:59:27 user nova-compute[76870]: No targets found.
Oct 20 14:59:27 user nova-compute[76870]: iSNS:
Oct 20 14:59:27 user nova-compute[76870]: No targets found.
Oct 20 14:59:27 user nova-compute[76870]: STATIC:
Oct 20 14:59:27 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 14:59:27 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:27 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:27 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6
Oct 20 14:59:27 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:27 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:27 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee
Oct 20 14:59:27 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 14:59:27 user nova-compute[76870]:                 Iface Name: default
Oct 20 14:59:27 user nova-compute[76870]: FIRMWARE:
Oct 20 14:59:27 user nova-compute[76870]: No targets found.
Oct 20 14:59:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 14:59:27 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 14:59:27 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da1d442-0768-47db-b3cf-9f9b26d1ea7b', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb70b02-eca7-40a8-8598-1a86f9aae02a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f034ab2-0fe6-4d7c-8084-59cd40d39aac]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:27 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:27 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:27 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:27 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8714af0>, {}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Disconnecting from: [] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== disconnect_volume: return (77ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 14:59:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Deleting instance files /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807_del
Oct 20 14:59:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Deletion of /opt/stack/data/nova/instances/a780b4af-69a3-4d2b-abfc-db081b38c807_del complete
Oct 20 14:59:27 user nova-compute[76870]: INFO nova.compute.manager [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 20 14:59:27 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 14:59:27 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 14:59:28 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:59:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-b844eb20-b1ba-4413-8a99-25257738eaac req-fe8c5d72-21b7-434a-b6e8-cde78a492970 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-vif-deleted-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:28 user nova-compute[76870]: INFO nova.compute.manager [req-b844eb20-b1ba-4413-8a99-25257738eaac req-fe8c5d72-21b7-434a-b6e8-cde78a492970 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Neutron deleted interface a2639df6-f7d8-4e1f-8f98-5f9ba4474138; detaching it from the instance and deleting it from the info cache
Oct 20 14:59:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-b844eb20-b1ba-4413-8a99-25257738eaac req-fe8c5d72-21b7-434a-b6e8-cde78a492970 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:59:28 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Took 0.71 seconds to deallocate network for instance.
Oct 20 14:59:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-b844eb20-b1ba-4413-8a99-25257738eaac req-fe8c5d72-21b7-434a-b6e8-cde78a492970 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Detach interface failed, port_id=a2639df6-f7d8-4e1f-8f98-5f9ba4474138, reason: Instance a780b4af-69a3-4d2b-abfc-db081b38c807 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 14:59:28 user nova-compute[76870]: WARNING nova.volume.cinder [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Attachment ccdb31c0-3c0c-4d83-87e1-7296494cfeb8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ccdb31c0-3c0c-4d83-87e1-7296494cfeb8. (HTTP 404) (Request-ID: req-54514717-9280-4934-bbbf-92de4a015f73)
Oct 20 14:59:28 user nova-compute[76870]: INFO nova.compute.manager [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Took 0.02 seconds to detach 1 volumes for instance.
Oct 20 14:59:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:28 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:59:28 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:59:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:29 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Deleted allocations for instance a780b4af-69a3-4d2b-abfc-db081b38c807
Oct 20 14:59:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-32334e8c-74b9-4836-97a8-1a94e2773c1b tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.126s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-15ee55db-0d16-4491-b27f-695071741870 req-86d5c846-7170-4a04-8e4d-6cefcac98288 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received event network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-15ee55db-0d16-4491-b27f-695071741870 req-86d5c846-7170-4a04-8e4d-6cefcac98288 service nova] Acquiring lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-15ee55db-0d16-4491-b27f-695071741870 req-86d5c846-7170-4a04-8e4d-6cefcac98288 service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-15ee55db-0d16-4491-b27f-695071741870 req-86d5c846-7170-4a04-8e4d-6cefcac98288 service nova] Lock "a780b4af-69a3-4d2b-abfc-db081b38c807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-15ee55db-0d16-4491-b27f-695071741870 req-86d5c846-7170-4a04-8e4d-6cefcac98288 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] No waiting events found dispatching network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:59:29 user nova-compute[76870]: WARNING nova.compute.manager [req-15ee55db-0d16-4491-b27f-695071741870 req-86d5c846-7170-4a04-8e4d-6cefcac98288 service nova] [instance: a780b4af-69a3-4d2b-abfc-db081b38c807] Received unexpected event network-vif-plugged-a2639df6-f7d8-4e1f-8f98-5f9ba4474138 for instance with vm_state deleted and task_state None.
Oct 20 14:59:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 14:59:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Creating image(s)
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Ensure instance console log exists: /opt/stack/data/nova/instances/1105dae2-5647-42a9-8a64-00947a5cd1c8/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Start _get_guest_xml network_info=[{"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T14:58:58Z,direct_url=<?>,disk_format='qcow2',id=7cb5f892-5cde-4998-b6ce-2f83279acf51,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1026381217',owner='710a95fd9def4ae08263d4cdafbdffd3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T14:59:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8e1913a0-f8e9-44b4-89da-e2204ff1e4d2', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlVBIPqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1105dae2-5647-42a9-8a64-00947a5cd1c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c20a7e11-c1bc-48f8-95b1-50455845f85f', 'serial': 'c20a7e11-c1bc-48f8-95b1-50455845f85f'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 14:59:34 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:59:34 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T14:58:58Z,direct_url=<?>,disk_format='qcow2',id=7cb5f892-5cde-4998-b6ce-2f83279acf51,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1026381217',owner='710a95fd9def4ae08263d4cdafbdffd3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T14:59:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlVBIPqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 14:59:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:59:34 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 14:59:34 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7ee7c-97c1-4581-8c0b-888c9339c051]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 14:59:34 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2bdd0e-bebf-4a5f-9d0e-d7c2f303f202]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f] added
Oct 20 14:59:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c569497b-ddf0-4d1c-9354-be7ca8a391f9]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb28325-3494-4f50-8cf5-c596d3396d86]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlVBIPqW {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlVBIPqW" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbcc85c-f43a-4b89-bd8c-2fc0752c1d2c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RlVBIPqW'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ea443-be50-4114-b055-f34ba67560c0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5180af76-e32c-4d7c-9537-6a0b258cd1f4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8998d30-6103-4d1b-baed-4c7a55b1b309]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260]
Oct 20 14:59:34 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260] successful.
Oct 20 14:59:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a61a8-57ba-4f0f-bfcf-0c5946a8dff4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9272217-f37b-4d6f-ae2e-405784189c36]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 14:59:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 14:59:34 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 14:59:34 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f2d46c-9fb6-4d50-9c4d-dd7bdb4d995f]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlVBIPqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 14:59:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23962646366303936', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962646366303936', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-117464407',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-117464407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-117464407',id=38,image_ref='7cb5f892-5cde-4998-b6ce-2f83279acf51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOChdAOtT4EArN4tzkX1dp5t3m2hnl2yQtt35Baz7GFPC88z3wuRsw7LdDfs3o9iHVzdZh2QjY1VrWcqOoe1PlD4TEYrTUEsBFJov2qiJ3LK54ijO8o7Uh4yN0bXm9meWw==',key_name='tempest-keypair-1355158532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-eaalf618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2023237776',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=1105dae2-5647-42a9-8a64-00947a5cd1c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'pci_devices' on Instance uuid 1105dae2-5647-42a9-8a64-00947a5cd1c8 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 14:59:35 user nova-compute[76870]:   <uuid>1105dae2-5647-42a9-8a64-00947a5cd1c8</uuid>
Oct 20 14:59:35 user nova-compute[76870]:   <name>instance-00000026</name>
Oct 20 14:59:35 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 14:59:35 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 14:59:35 user nova-compute[76870]:   <metadata>
Oct 20 14:59:35 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 14:59:35 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 14:59:35 user nova-compute[76870]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-117464407</nova:name>
Oct 20 14:59:35 user nova-compute[76870]:       <nova:creationTime>2023-10-20 14:59:34</nova:creationTime>
Oct 20 14:59:35 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 14:59:35 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 14:59:35 user nova-compute[76870]:       </nova:flavor>
Oct 20 14:59:35 user nova-compute[76870]:       <nova:owner>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:user uuid="407faf0fe9f44219a2d0580e9819f8ec">tempest-TestVolumeBootPattern-2023237776-project-member</nova:user>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:project uuid="710a95fd9def4ae08263d4cdafbdffd3">tempest-TestVolumeBootPattern-2023237776</nova:project>
Oct 20 14:59:35 user nova-compute[76870]:       </nova:owner>
Oct 20 14:59:35 user nova-compute[76870]:       <nova:root type="image" uuid="7cb5f892-5cde-4998-b6ce-2f83279acf51"/>
Oct 20 14:59:35 user nova-compute[76870]:       <nova:ports>
Oct 20 14:59:35 user nova-compute[76870]:         <nova:port uuid="8da6a17f-3d65-49a6-b17d-576bd6320f22">
Oct 20 14:59:35 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 14:59:35 user nova-compute[76870]:         </nova:port>
Oct 20 14:59:35 user nova-compute[76870]:       </nova:ports>
Oct 20 14:59:35 user nova-compute[76870]:     </nova:instance>
Oct 20 14:59:35 user nova-compute[76870]:   </metadata>
Oct 20 14:59:35 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 14:59:35 user nova-compute[76870]:     <system>
Oct 20 14:59:35 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 14:59:35 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 14:59:35 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 14:59:35 user nova-compute[76870]:       <entry name="serial">1105dae2-5647-42a9-8a64-00947a5cd1c8</entry>
Oct 20 14:59:35 user nova-compute[76870]:       <entry name="uuid">1105dae2-5647-42a9-8a64-00947a5cd1c8</entry>
Oct 20 14:59:35 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 14:59:35 user nova-compute[76870]:     </system>
Oct 20 14:59:35 user nova-compute[76870]:   </sysinfo>
Oct 20 14:59:35 user nova-compute[76870]:   <os>
Oct 20 14:59:35 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 14:59:35 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 14:59:35 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 14:59:35 user nova-compute[76870]:   </os>
Oct 20 14:59:35 user nova-compute[76870]:   <features>
Oct 20 14:59:35 user nova-compute[76870]:     <acpi/>
Oct 20 14:59:35 user nova-compute[76870]:     <apic/>
Oct 20 14:59:35 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 14:59:35 user nova-compute[76870]:   </features>
Oct 20 14:59:35 user nova-compute[76870]:   <clock offset="utc">
Oct 20 14:59:35 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 14:59:35 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 14:59:35 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 14:59:35 user nova-compute[76870]:   </clock>
Oct 20 14:59:35 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 14:59:35 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 14:59:35 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 14:59:35 user nova-compute[76870]:   </cpu>
Oct 20 14:59:35 user nova-compute[76870]:   <devices>
Oct 20 14:59:35 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 14:59:35 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 14:59:35 user nova-compute[76870]:       <source dev="/dev/sdc"/>
Oct 20 14:59:35 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 14:59:35 user nova-compute[76870]:       <serial>c20a7e11-c1bc-48f8-95b1-50455845f85f</serial>
Oct 20 14:59:35 user nova-compute[76870]:     </disk>
Oct 20 14:59:35 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 14:59:35 user nova-compute[76870]:       <mac address="fa:16:3e:a8:16:a8"/>
Oct 20 14:59:35 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:59:35 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 14:59:35 user nova-compute[76870]:       <target dev="tap8da6a17f-3d"/>
Oct 20 14:59:35 user nova-compute[76870]:     </interface>
Oct 20 14:59:35 user nova-compute[76870]:     <serial type="pty">
Oct 20 14:59:35 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/1105dae2-5647-42a9-8a64-00947a5cd1c8/console.log" append="off"/>
Oct 20 14:59:35 user nova-compute[76870]:     </serial>
Oct 20 14:59:35 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 14:59:35 user nova-compute[76870]:     <video>
Oct 20 14:59:35 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 14:59:35 user nova-compute[76870]:     </video>
Oct 20 14:59:35 user nova-compute[76870]:     <rng model="virtio">
Oct 20 14:59:35 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 14:59:35 user nova-compute[76870]:     </rng>
Oct 20 14:59:35 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 14:59:35 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 14:59:35 user nova-compute[76870]:       <stats period="10"/>
Oct 20 14:59:35 user nova-compute[76870]:     </memballoon>
Oct 20 14:59:35 user nova-compute[76870]:   </devices>
Oct 20 14:59:35 user nova-compute[76870]: </domain>
Oct 20 14:59:35 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-117464407',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-117464407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-117464407',id=38,image_ref='7cb5f892-5cde-4998-b6ce-2f83279acf51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOChdAOtT4EArN4tzkX1dp5t3m2hnl2yQtt35Baz7GFPC88z3wuRsw7LdDfs3o9iHVzdZh2QjY1VrWcqOoe1PlD4TEYrTUEsBFJov2qiJ3LK54ijO8o7Uh4yN0bXm9meWw==',key_name='tempest-keypair-1355158532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-eaalf618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2023237776',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T14:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=1105dae2-5647-42a9-8a64-00947a5cd1c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG os_vif [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06de26f8-67de-5465-b2be-a37ea0f81790', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8da6a17f-3d, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8da6a17f-3d, col_values=(('qos', UUID('b8531cd0-2001-4b8d-a7c9-4a1c5573b1ae')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8da6a17f-3d, col_values=(('external_ids', {'iface-id': '8da6a17f-3d65-49a6-b17d-576bd6320f22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:16:a8', 'vm-uuid': '1105dae2-5647-42a9-8a64-00947a5cd1c8'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:35 user nova-compute[76870]: INFO os_vif [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d')
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 14:59:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No VIF found with MAC fa:16:3e:a8:16:a8, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 14:59:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-a8b01f15-af3a-4447-9ab7-25c8a9903eaf req-54512c39-74cf-4a4f-8836-4f22085cbc1b service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a8b01f15-af3a-4447-9ab7-25c8a9903eaf req-54512c39-74cf-4a4f-8836-4f22085cbc1b service nova] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a8b01f15-af3a-4447-9ab7-25c8a9903eaf req-54512c39-74cf-4a4f-8836-4f22085cbc1b service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a8b01f15-af3a-4447-9ab7-25c8a9903eaf req-54512c39-74cf-4a4f-8836-4f22085cbc1b service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-a8b01f15-af3a-4447-9ab7-25c8a9903eaf req-54512c39-74cf-4a4f-8836-4f22085cbc1b service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] No waiting events found dispatching network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:59:37 user nova-compute[76870]: WARNING nova.compute.manager [req-a8b01f15-af3a-4447-9ab7-25c8a9903eaf req-54512c39-74cf-4a4f-8836-4f22085cbc1b service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received unexpected event network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 for instance with vm_state building and task_state spawning.
Oct 20 14:59:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 14:59:39 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Instance spawned successfully.
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 14:59:39 user nova-compute[76870]: INFO nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 14:59:39 user nova-compute[76870]: INFO nova.compute.manager [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Took 29.46 seconds to build instance.
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-1a05a687-6bce-403b-b177-b6e8f92b8c9a req-dbd682c6-43b1-482b-a468-d8abecd359ad service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1a05a687-6bce-403b-b177-b6e8f92b8c9a req-dbd682c6-43b1-482b-a468-d8abecd359ad service nova] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1a05a687-6bce-403b-b177-b6e8f92b8c9a req-dbd682c6-43b1-482b-a468-d8abecd359ad service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1a05a687-6bce-403b-b177-b6e8f92b8c9a req-dbd682c6-43b1-482b-a468-d8abecd359ad service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-1a05a687-6bce-403b-b177-b6e8f92b8c9a req-dbd682c6-43b1-482b-a468-d8abecd359ad service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] No waiting events found dispatching network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 14:59:39 user nova-compute[76870]: WARNING nova.compute.manager [req-1a05a687-6bce-403b-b177-b6e8f92b8c9a req-dbd682c6-43b1-482b-a468-d8abecd359ad service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received unexpected event network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 for instance with vm_state active and task_state None.
Oct 20 14:59:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a2baa5d0-ec98-465b-a52e-c8f3c46e43c5 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.604s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:45 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 14:59:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 14:59:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:53 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 14:59:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 14:59:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 14:59:56 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:59:56 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.099761962890625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c1b032b7-20ca-49f7-9f5f-ce0632256594 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 1105dae2-5647-42a9-8a64-00947a5cd1c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 14:59:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [{"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-85c1fb0e-ae51-453e-9bbc-7f86370d44d4" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 14:59:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-changed-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Refreshing instance network info cache due to event network-changed-fa79a316-749b-41e5-811d-c28cdd5ae51e. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Refreshing network info cache for port fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated VIF entry in instance network info cache for port fa79a316-749b-41e5-811d-c28cdd5ae51e. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG nova.network.neutron [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d381b85a-b52b-47a3-91cd-aa57cda2661e req-b91ad9a1-0590-4731-8296-34cbf5590971 service nova] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Stashing vm_state: active {{(pid=76870) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:00:15 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:00:15 user nova-compute[76870]: INFO nova.compute.claims [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Claim successful on node user
Oct 20 15:00:15 user nova-compute[76870]: INFO nova.compute.resource_tracker [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating resource usage from migration 9d784d79-5326-4901-9bec-570451ecf5b7
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.447s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:16 user nova-compute[76870]: INFO nova.compute.manager [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Migrating
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.network.neutron [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-changed-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Refreshing instance network info cache due to event network-changed-1752f9e4-bac7-4948-934b-27899ad99c04. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.network.neutron [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Refreshing network info cache for port 1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Starting migrate_disk_and_power_off {{(pid=76870) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-b71a7459-a5f6-4fcb-9703-ff37ecf9c6ad req-3e7159ef-4280-4504-bbf5-b181d49d13f1 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-unplugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b71a7459-a5f6-4fcb-9703-ff37ecf9c6ad req-3e7159ef-4280-4504-bbf5-b181d49d13f1 service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b71a7459-a5f6-4fcb-9703-ff37ecf9c6ad req-3e7159ef-4280-4504-bbf5-b181d49d13f1 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b71a7459-a5f6-4fcb-9703-ff37ecf9c6ad req-3e7159ef-4280-4504-bbf5-b181d49d13f1 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-b71a7459-a5f6-4fcb-9703-ff37ecf9c6ad req-3e7159ef-4280-4504-bbf5-b181d49d13f1 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-unplugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:00:16 user nova-compute[76870]: WARNING nova.compute.manager [req-b71a7459-a5f6-4fcb-9703-ff37ecf9c6ad req-3e7159ef-4280-4504-bbf5-b181d49d13f1 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-unplugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state active and task_state resize_migrating.
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updated VIF entry in instance network info cache for port 1752f9e4-bac7-4948-934b-27899ad99c04. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG nova.network.neutron [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7c01c9eb-f631-42ae-89ce-df93981250f6 req-88bd34b4-c199-4e1f-8a91-d111845116c5 service nova] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:17 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance destroyed successfully.
Oct 20 15:00:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-932890794',display_name='tempest-ServerActionsTestOtherA-server-932890794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-932890794',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-yatnb2fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c575033f-89b0-4e8e-a827-50c8ab260713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1752f9e4-ba, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3919fe6b-1bf4-44a1-9a9d-f3e8e2c9e4aa) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:17 user nova-compute[76870]: INFO os_vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba')
Oct 20 15:00:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:00:17 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a60de-369a-4584-aaba-42ccf4c05d10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:00:17 user nova-compute[76870]: No targets found.
Oct 20 15:00:17 user nova-compute[76870]: iSNS:
Oct 20 15:00:17 user nova-compute[76870]: No targets found.
Oct 20 15:00:17 user nova-compute[76870]: STATIC:
Oct 20 15:00:17 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:00:17 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:17 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:17 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f
Oct 20 15:00:17 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:17 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:17 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6
Oct 20 15:00:17 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:17 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:17 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee
Oct 20 15:00:17 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:17 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:17 user nova-compute[76870]: FIRMWARE:
Oct 20 15:00:17 user nova-compute[76870]: No targets found.
Oct 20 15:00:17 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:00:17 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:00:17 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd2e38-7ccc-4fa9-a0b8-339e6a87e01d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f48d40-af69-4593-80bb-9bd947ff646b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:17 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:17 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:00:17 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:17 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:17 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:17 user nova-compute[76870]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:00:17 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:17 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c69b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c'): ({'sde'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Removing single pathed devices sde {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6652803e-b1d0-4b05-ae15-dedc91e611d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee51240-0159-493e-8ddf-b50e61b81741]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flushing IO for device /dev/sde {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a02c83-a9b6-4ba7-8f62-808c316e2ec7]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f154c999-1711-41e5-aac6-fd0b851f3862]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d12f29-c502-42f5-b82e-703f2fbc66f8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b61ec87-bf4d-4fba-b1d2-7c2e3e40de9a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]
Oct 20 15:00:17 user nova-compute[76870]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.
Oct 20 15:00:17 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6f7d9a-e6df-4cba-96d7-425ef88b2856]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== disconnect_volume: return (298ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:00:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:00:18 user nova-compute[76870]: DEBUG nova.network.neutron [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Port 1752f9e4-bac7-4948-934b-27899ad99c04 binding to destination host user is already ACTIVE {{(pid=76870) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 15:00:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-0ae4548c-9c0a-4c9c-9d7f-0e94dea27f17 req-c7b6c2bd-2ee8-4d08-b5a7-1245d546591e service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0ae4548c-9c0a-4c9c-9d7f-0e94dea27f17 req-c7b6c2bd-2ee8-4d08-b5a7-1245d546591e service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0ae4548c-9c0a-4c9c-9d7f-0e94dea27f17 req-c7b6c2bd-2ee8-4d08-b5a7-1245d546591e service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0ae4548c-9c0a-4c9c-9d7f-0e94dea27f17 req-c7b6c2bd-2ee8-4d08-b5a7-1245d546591e service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-0ae4548c-9c0a-4c9c-9d7f-0e94dea27f17 req-c7b6c2bd-2ee8-4d08-b5a7-1245d546591e service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:00:18 user nova-compute[76870]: WARNING nova.compute.manager [req-0ae4548c-9c0a-4c9c-9d7f-0e94dea27f17 req-c7b6c2bd-2ee8-4d08-b5a7-1245d546591e service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state active and task_state resize_migrating.
Oct 20 15:00:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG nova.network.neutron [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG nova.network.neutron [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG os_brick.utils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786eec1-2d96-4740-9a84-e9805260bf09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8afa032-4075-4c93-b5da-ae880ac8f812]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[52064242-0333-46fd-bf1f-94abe69cb261]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493b5d8-9ae9-4f15-b3f9-7ec3e1890940]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:00:20 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ea023-f3dc-45cc-889a-51e16757978d]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG os_brick.utils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:20 user nova-compute[76870]: INFO nova.compute.manager [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Detaching volume d7b141be-cbac-4015-8673-3ef128a2e1ee
Oct 20 15:00:20 user nova-compute[76870]: INFO nova.virt.block_device [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Attempting to driver detach volume d7b141be-cbac-4015-8673-3ef128a2e1ee from mountpoint /dev/vdb
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Attempting to detach device vdb from instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:00:20 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:00:20 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:00:20 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:00:20 user nova-compute[76870]:   <serial>d7b141be-cbac-4015-8673-3ef128a2e1ee</serial>
Oct 20 15:00:20 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:00:20 user nova-compute[76870]: </disk>
Oct 20 15:00:20 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:00:20 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully detached device vdb from instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d from the persistent domain config.
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:00:20 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:00:20 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:00:20 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:00:20 user nova-compute[76870]:   <serial>d7b141be-cbac-4015-8673-3ef128a2e1ee</serial>
Oct 20 15:00:20 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:00:20 user nova-compute[76870]: </disk>
Oct 20 15:00:20 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.compute.manager [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing instance network info cache due to event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:20 user nova-compute[76870]: DEBUG nova.network.neutron [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updated VIF entry in instance network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing instance network info cache due to event network-changed-cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Refreshing network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updated VIF entry in instance network info cache for port cc9c95d3-deb4-493d-b45f-c0c2205d8c46. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG nova.network.neutron [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c380b27f-8024-40fe-8d15-19835db80515 req-b4cd35e4-3d23-44ab-8d05-e0b3c5b3de57 service nova] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Starting finish_migration {{(pid=76870) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 15:00:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Creating image(s)
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Ensure instance console log exists: /opt/stack/data/nova/instances/c575033f-89b0-4e8e-a827-50c8ab260713/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Start _get_guest_xml network_info=[{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0ca7e83d-0dab-4e6a-8152-962e28c36b9a', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c575033f-89b0-4e8e-a827-50c8ab260713', 'attached_at': '2023-10-20T15:00:37.000000', 'detached_at': '', 'volume_id': 'a56bdb25-c021-4456-8852-5d580d153a1c', 'serial': 'a56bdb25-c021-4456-8852-5d580d153a1c'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:00:37 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:00:37 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:00:37 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:00:37 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:00:37 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:00:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68c16cc-1893-402a-8f8c-673f04b0ff44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:00:37 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:00:37 user nova-compute[76870]: INFO nova.compute.claims [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Claim successful on node user
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff17401-a942-4829-99d8-94a4c11ce67e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c] added
Oct 20 15:00:37 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dea5923-bfce-4ec4-8a8d-c3d14ce79886]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517999d-8e97-45ed-a0e9-d696f1912348]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQhbuNBE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQhbuNBE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c159e658-6c7f-4579-8f53-dad19536748c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQhbuNBE'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4de32d-15b9-46a1-8565-a706ad1f30c0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf61cda-ef07-43ee-8e61-2e75673a487a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:37 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:37 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcffe43-f243-4457-a205-108b7e3ec355]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]
Oct 20 15:00:37 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.
Oct 20 15:00:37 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f933fb2-04a4-4e62-8d42-9ad9ceb7c1ba]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b088ef6-8800-4482-a2f4-498eea1ce286]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:00:37 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:37 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:00:37 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e54d8-c389-4a09-88ee-5c13b189e211]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:00:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:00:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.policy [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92a6a66a0ef4d5bb5a3c35db785fed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f630fc424cf49c7a2cd3881538e51c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:00:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Creating image(s)
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "/opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "/opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk 1073741824" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23034303665383563', 'path': '/dev/sde'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034303665383563', 'path': '/dev/sde'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-932890794',display_name='tempest-ServerActionsTestOtherA-server-932890794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-932890794',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-yatnb2fk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c575033f-89b0-4e8e-a827-50c8ab260713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:00:38 user nova-compute[76870]:   <uuid>c575033f-89b0-4e8e-a827-50c8ab260713</uuid>
Oct 20 15:00:38 user nova-compute[76870]:   <name>instance-00000025</name>
Oct 20 15:00:38 user nova-compute[76870]:   <memory>2097152</memory>
Oct 20 15:00:38 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:00:38 user nova-compute[76870]:   <metadata>
Oct 20 15:00:38 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:00:38 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:00:38 user nova-compute[76870]:       <nova:name>tempest-ServerActionsTestOtherA-server-932890794</nova:name>
Oct 20 15:00:38 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:00:37</nova:creationTime>
Oct 20 15:00:38 user nova-compute[76870]:       <nova:flavor name="m1.small">
Oct 20 15:00:38 user nova-compute[76870]:         <nova:memory>2048</nova:memory>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:disk>20</nova:disk>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:00:38 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:00:38 user nova-compute[76870]:       <nova:owner>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:user uuid="91e65eb07d084dcb9e5e9188961f4b44">tempest-ServerActionsTestOtherA-404958601-project-member</nova:user>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:project uuid="94c8ea9d998b4ba587b16fec8b792c13">tempest-ServerActionsTestOtherA-404958601</nova:project>
Oct 20 15:00:38 user nova-compute[76870]:       </nova:owner>
Oct 20 15:00:38 user nova-compute[76870]:       <nova:ports>
Oct 20 15:00:38 user nova-compute[76870]:         <nova:port uuid="1752f9e4-bac7-4948-934b-27899ad99c04">
Oct 20 15:00:38 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 15:00:38 user nova-compute[76870]:         </nova:port>
Oct 20 15:00:38 user nova-compute[76870]:       </nova:ports>
Oct 20 15:00:38 user nova-compute[76870]:     </nova:instance>
Oct 20 15:00:38 user nova-compute[76870]:   </metadata>
Oct 20 15:00:38 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:00:38 user nova-compute[76870]:     <system>
Oct 20 15:00:38 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:00:38 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:00:38 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:00:38 user nova-compute[76870]:       <entry name="serial">c575033f-89b0-4e8e-a827-50c8ab260713</entry>
Oct 20 15:00:38 user nova-compute[76870]:       <entry name="uuid">c575033f-89b0-4e8e-a827-50c8ab260713</entry>
Oct 20 15:00:38 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:00:38 user nova-compute[76870]:     </system>
Oct 20 15:00:38 user nova-compute[76870]:   </sysinfo>
Oct 20 15:00:38 user nova-compute[76870]:   <os>
Oct 20 15:00:38 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:00:38 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:00:38 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:00:38 user nova-compute[76870]:   </os>
Oct 20 15:00:38 user nova-compute[76870]:   <features>
Oct 20 15:00:38 user nova-compute[76870]:     <acpi/>
Oct 20 15:00:38 user nova-compute[76870]:     <apic/>
Oct 20 15:00:38 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:00:38 user nova-compute[76870]:   </features>
Oct 20 15:00:38 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:00:38 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:00:38 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:00:38 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:00:38 user nova-compute[76870]:   </clock>
Oct 20 15:00:38 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:00:38 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:00:38 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:00:38 user nova-compute[76870]:   </cpu>
Oct 20 15:00:38 user nova-compute[76870]:   <devices>
Oct 20 15:00:38 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:00:38 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:00:38 user nova-compute[76870]:       <source dev="/dev/sde"/>
Oct 20 15:00:38 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:00:38 user nova-compute[76870]:       <serial>a56bdb25-c021-4456-8852-5d580d153a1c</serial>
Oct 20 15:00:38 user nova-compute[76870]:     </disk>
Oct 20 15:00:38 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:00:38 user nova-compute[76870]:       <mac address="fa:16:3e:91:96:17"/>
Oct 20 15:00:38 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:00:38 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:00:38 user nova-compute[76870]:       <target dev="tap1752f9e4-ba"/>
Oct 20 15:00:38 user nova-compute[76870]:     </interface>
Oct 20 15:00:38 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:00:38 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c575033f-89b0-4e8e-a827-50c8ab260713/console.log" append="off"/>
Oct 20 15:00:38 user nova-compute[76870]:     </serial>
Oct 20 15:00:38 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:00:38 user nova-compute[76870]:     <video>
Oct 20 15:00:38 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:00:38 user nova-compute[76870]:     </video>
Oct 20 15:00:38 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:00:38 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:00:38 user nova-compute[76870]:     </rng>
Oct 20 15:00:38 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:00:38 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:00:38 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:00:38 user nova-compute[76870]:     </memballoon>
Oct 20 15:00:38 user nova-compute[76870]:   </devices>
Oct 20 15:00:38 user nova-compute[76870]: </domain>
Oct 20 15:00:38 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-932890794',display_name='tempest-ServerActionsTestOtherA-server-932890794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-932890794',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-yatnb2fk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c575033f-89b0-4e8e-a827-50c8ab260713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1447087270-network", "vif_mac": "fa:16:3e:91:96:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG os_vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44594d17-7836-5c86-93be-ff3792c5f5e8', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1752f9e4-ba, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1752f9e4-ba, col_values=(('qos', UUID('de94414c-1ebe-4009-993f-24cbe53a6877')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1752f9e4-ba, col_values=(('external_ids', {'iface-id': '1752f9e4-bac7-4948-934b-27899ad99c04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:96:17', 'vm-uuid': 'c575033f-89b0-4e8e-a827-50c8ab260713'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:38 user nova-compute[76870]: INFO os_vif [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba')
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] No VIF found with MAC fa:16:3e:91:96:17, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Cannot resize image /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Ensure instance console log exists: /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:38 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Successfully created port: 425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Successfully updated port: 425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquired lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-changed-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Refreshing instance network info cache due to event network-changed-425cd9d9-f423-4069-b010-00db8691b7bf. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] Acquiring lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updating instance_info_cache with network_info: [{"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Releasing lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Instance network_info: |[{"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] Acquired lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Refreshing network info cache for port 425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Start _get_guest_xml network_info=[{"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:00:39 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:00:39 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1391235145',display_name='tempest-VolumesSnapshotTestJSON-instance-1391235145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1391235145',id=39,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA//fh5jGwvGw4iJd05wzSrCL5he4ELRnDIUQiFh/LQZ/kNU9+kZ7+MWK6ZO0rhxWV7n3cPohA/cYz/5pbXBesZ5MARRV/k7ZPyW12j0FmUdwwbE1/3OqHb17fiOD9TS4Q==',key_name='tempest-keypair-858246862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f630fc424cf49c7a2cd3881538e51c2',ramdisk_id='',reservation_id='r-vrglmwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-380444352',owner_user_name='tempest-VolumesSnapshotTestJSON-380444352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92a6a66a0ef4d5bb5a3c35db785fed7',uuid=ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converting VIF {"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'pci_devices' on Instance uuid ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:00:39 user nova-compute[76870]:   <uuid>ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745</uuid>
Oct 20 15:00:39 user nova-compute[76870]:   <name>instance-00000027</name>
Oct 20 15:00:39 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:00:39 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:00:39 user nova-compute[76870]:   <metadata>
Oct 20 15:00:39 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:00:39 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:00:39 user nova-compute[76870]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1391235145</nova:name>
Oct 20 15:00:39 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:00:39</nova:creationTime>
Oct 20 15:00:39 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:00:39 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:00:39 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:00:39 user nova-compute[76870]:       <nova:owner>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:user uuid="b92a6a66a0ef4d5bb5a3c35db785fed7">tempest-VolumesSnapshotTestJSON-380444352-project-member</nova:user>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:project uuid="2f630fc424cf49c7a2cd3881538e51c2">tempest-VolumesSnapshotTestJSON-380444352</nova:project>
Oct 20 15:00:39 user nova-compute[76870]:       </nova:owner>
Oct 20 15:00:39 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:00:39 user nova-compute[76870]:       <nova:ports>
Oct 20 15:00:39 user nova-compute[76870]:         <nova:port uuid="425cd9d9-f423-4069-b010-00db8691b7bf">
Oct 20 15:00:39 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 15:00:39 user nova-compute[76870]:         </nova:port>
Oct 20 15:00:39 user nova-compute[76870]:       </nova:ports>
Oct 20 15:00:39 user nova-compute[76870]:     </nova:instance>
Oct 20 15:00:39 user nova-compute[76870]:   </metadata>
Oct 20 15:00:39 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:00:39 user nova-compute[76870]:     <system>
Oct 20 15:00:39 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:00:39 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:00:39 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:00:39 user nova-compute[76870]:       <entry name="serial">ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745</entry>
Oct 20 15:00:39 user nova-compute[76870]:       <entry name="uuid">ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745</entry>
Oct 20 15:00:39 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:00:39 user nova-compute[76870]:     </system>
Oct 20 15:00:39 user nova-compute[76870]:   </sysinfo>
Oct 20 15:00:39 user nova-compute[76870]:   <os>
Oct 20 15:00:39 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:00:39 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:00:39 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:00:39 user nova-compute[76870]:   </os>
Oct 20 15:00:39 user nova-compute[76870]:   <features>
Oct 20 15:00:39 user nova-compute[76870]:     <acpi/>
Oct 20 15:00:39 user nova-compute[76870]:     <apic/>
Oct 20 15:00:39 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:00:39 user nova-compute[76870]:   </features>
Oct 20 15:00:39 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:00:39 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:00:39 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:00:39 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:00:39 user nova-compute[76870]:   </clock>
Oct 20 15:00:39 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:00:39 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:00:39 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:00:39 user nova-compute[76870]:   </cpu>
Oct 20 15:00:39 user nova-compute[76870]:   <devices>
Oct 20 15:00:39 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:00:39 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:00:39 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk"/>
Oct 20 15:00:39 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:00:39 user nova-compute[76870]:     </disk>
Oct 20 15:00:39 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:00:39 user nova-compute[76870]:       <mac address="fa:16:3e:1f:58:4e"/>
Oct 20 15:00:39 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:00:39 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:00:39 user nova-compute[76870]:       <target dev="tap425cd9d9-f4"/>
Oct 20 15:00:39 user nova-compute[76870]:     </interface>
Oct 20 15:00:39 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:00:39 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/console.log" append="off"/>
Oct 20 15:00:39 user nova-compute[76870]:     </serial>
Oct 20 15:00:39 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:00:39 user nova-compute[76870]:     <video>
Oct 20 15:00:39 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:00:39 user nova-compute[76870]:     </video>
Oct 20 15:00:39 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:00:39 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:00:39 user nova-compute[76870]:     </rng>
Oct 20 15:00:39 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:00:39 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:00:39 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:00:39 user nova-compute[76870]:     </memballoon>
Oct 20 15:00:39 user nova-compute[76870]:   </devices>
Oct 20 15:00:39 user nova-compute[76870]: </domain>
Oct 20 15:00:39 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1391235145',display_name='tempest-VolumesSnapshotTestJSON-instance-1391235145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1391235145',id=39,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA//fh5jGwvGw4iJd05wzSrCL5he4ELRnDIUQiFh/LQZ/kNU9+kZ7+MWK6ZO0rhxWV7n3cPohA/cYz/5pbXBesZ5MARRV/k7ZPyW12j0FmUdwwbE1/3OqHb17fiOD9TS4Q==',key_name='tempest-keypair-858246862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f630fc424cf49c7a2cd3881538e51c2',ramdisk_id='',reservation_id='r-vrglmwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-380444352',owner_user_name='tempest-VolumesSnapshotTestJSON-380444352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92a6a66a0ef4d5bb5a3c35db785fed7',uuid=ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converting VIF {"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG os_vif [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c30e3c6-43f3-51f7-8e99-6a61ba05d0e7', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap425cd9d9-f4, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap425cd9d9-f4, col_values=(('qos', UUID('7c312cc8-a242-43c8-b2b9-c4da12a7b2a0')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap425cd9d9-f4, col_values=(('external_ids', {'iface-id': '425cd9d9-f423-4069-b010-00db8691b7bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:58:4e', 'vm-uuid': 'ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:39 user nova-compute[76870]: INFO os_vif [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4')
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No VIF found with MAC fa:16:3e:1f:58:4e, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.network.neutron [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updated VIF entry in instance network info cache for port 425cd9d9-f423-4069-b010-00db8691b7bf. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.network.neutron [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updating instance_info_cache with network_info: [{"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f0ed5a34-10f4-49e3-a3c3-d0740b7bbe59 req-98b32df0-69c4-423e-b0e1-1bf22babcdaf service nova] Releasing lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-aa8722d0-9800-4b57-97f3-8896a9c0fb8b req-0c58e807-73c6-4ca3-8ac7-cc00d2e52657 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aa8722d0-9800-4b57-97f3-8896a9c0fb8b req-0c58e807-73c6-4ca3-8ac7-cc00d2e52657 service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aa8722d0-9800-4b57-97f3-8896a9c0fb8b req-0c58e807-73c6-4ca3-8ac7-cc00d2e52657 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-aa8722d0-9800-4b57-97f3-8896a9c0fb8b req-0c58e807-73c6-4ca3-8ac7-cc00d2e52657 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-aa8722d0-9800-4b57-97f3-8896a9c0fb8b req-0c58e807-73c6-4ca3-8ac7-cc00d2e52657 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:00:40 user nova-compute[76870]: WARNING nova.compute.manager [req-aa8722d0-9800-4b57-97f3-8896a9c0fb8b req-0c58e807-73c6-4ca3-8ac7-cc00d2e52657 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state active and task_state resize_finish.
Oct 20 15:00:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:40 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d is timed out.
Oct 20 15:00:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully detached device vdb from instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d from the live domain config.
Oct 20 15:00:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCpRZhIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:00:40 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[22654944-9eac-4db5-a2d5-6f0a82c675db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:00:40 user nova-compute[76870]: No targets found.
Oct 20 15:00:40 user nova-compute[76870]: iSNS:
Oct 20 15:00:40 user nova-compute[76870]: No targets found.
Oct 20 15:00:40 user nova-compute[76870]: STATIC:
Oct 20 15:00:40 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:00:40 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:40 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:40 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f
Oct 20 15:00:40 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:40 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:40 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6
Oct 20 15:00:40 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:40 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:40 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee
Oct 20 15:00:40 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:00:40 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:00:40 user nova-compute[76870]: FIRMWARE:
Oct 20 15:00:40 user nova-compute[76870]: No targets found.
Oct 20 15:00:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:00:40 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:00:40 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c07c02-a14a-4e2a-b5f0-ea7b44f93353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71484f-d739-47b5-81e1-658d8122a066]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:40 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:40 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:40 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:00:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee (non-flash)
Oct 20 15:00:40 user nova-compute[76870]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:00:40 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:00:40 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:00:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c204b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431b68c-e977-4c6b-b149-7bbfbd0d994f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f9e61c-6132-4f09-b517-13dc8f4334a3]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369ee4c-a7e5-4c20-b518-4fa1bbbdbe51]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f625b6b-3ebb-4dfe-b02d-96dd08774a13]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26cf0d1-f33d-4493-9a54-d65549b07920]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ecc957-656b-4b4e-b299-be5f5cad16e8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260]
Oct 20 15:00:41 user nova-compute[76870]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee, portal: 172.16.0.220,3260] successful.
Oct 20 15:00:41 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b141be-cbac-4015-8673-3ef128a2e1ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c167c31-980a-4082-b826-42502ceac2ca]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] <== disconnect_volume: return (295ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'flavor' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:00:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8a38ecf6-d0da-4f5f-9626-2f3d6f581e44 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-d7c6ae20-1dcb-4583-8fa1-138b430347a3 req-f5cdc984-0903-4381-9337-3f7a0557b347 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d7c6ae20-1dcb-4583-8fa1-138b430347a3 req-f5cdc984-0903-4381-9337-3f7a0557b347 service nova] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d7c6ae20-1dcb-4583-8fa1-138b430347a3 req-f5cdc984-0903-4381-9337-3f7a0557b347 service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d7c6ae20-1dcb-4583-8fa1-138b430347a3 req-f5cdc984-0903-4381-9337-3f7a0557b347 service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-d7c6ae20-1dcb-4583-8fa1-138b430347a3 req-f5cdc984-0903-4381-9337-3f7a0557b347 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] No waiting events found dispatching network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:00:42 user nova-compute[76870]: WARNING nova.compute.manager [req-d7c6ae20-1dcb-4583-8fa1-138b430347a3 req-f5cdc984-0903-4381-9337-3f7a0557b347 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received unexpected event network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf for instance with vm_state building and task_state spawning.
Oct 20 15:00:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-6a08bcf7-1692-47bc-8edd-c98453894975 req-c46d3274-5c6a-4329-9356-3642a5993c12 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6a08bcf7-1692-47bc-8edd-c98453894975 req-c46d3274-5c6a-4329-9356-3642a5993c12 service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6a08bcf7-1692-47bc-8edd-c98453894975 req-c46d3274-5c6a-4329-9356-3642a5993c12 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6a08bcf7-1692-47bc-8edd-c98453894975 req-c46d3274-5c6a-4329-9356-3642a5993c12 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-6a08bcf7-1692-47bc-8edd-c98453894975 req-c46d3274-5c6a-4329-9356-3642a5993c12 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:00:42 user nova-compute[76870]: WARNING nova.compute.manager [req-6a08bcf7-1692-47bc-8edd-c98453894975 req-c46d3274-5c6a-4329-9356-3642a5993c12 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state active and task_state resize_finish.
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:00:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance running successfully.
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Failed to set time: agent not configured {{(pid=76870) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-d264418f-924f-4b38-aa99-1bb0110930cb tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] finish_migration finished successfully. {{(pid=76870) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:00:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Instance spawned successfully.
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:00:43 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:00:44 user nova-compute[76870]: INFO nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Took 6.00 seconds to spawn the instance on the hypervisor.
Oct 20 15:00:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:00:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-14ad6349-5baf-4ba3-ae5e-67dcf4d548d7 req-7886235c-5511-46a4-9156-dfe4ebe99d34 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:00:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14ad6349-5baf-4ba3-ae5e-67dcf4d548d7 req-7886235c-5511-46a4-9156-dfe4ebe99d34 service nova] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14ad6349-5baf-4ba3-ae5e-67dcf4d548d7 req-7886235c-5511-46a4-9156-dfe4ebe99d34 service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-14ad6349-5baf-4ba3-ae5e-67dcf4d548d7 req-7886235c-5511-46a4-9156-dfe4ebe99d34 service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-14ad6349-5baf-4ba3-ae5e-67dcf4d548d7 req-7886235c-5511-46a4-9156-dfe4ebe99d34 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] No waiting events found dispatching network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:00:44 user nova-compute[76870]: WARNING nova.compute.manager [req-14ad6349-5baf-4ba3-ae5e-67dcf4d548d7 req-7886235c-5511-46a4-9156-dfe4ebe99d34 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received unexpected event network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf for instance with vm_state building and task_state spawning.
Oct 20 15:00:44 user nova-compute[76870]: INFO nova.compute.manager [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Took 6.79 seconds to build instance.
Oct 20 15:00:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5f5b549-a54d-4fad-af58-4c89aa303d40 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.893s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:00:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:00:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:00:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:00:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:00:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:00:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:00:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:00:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:00:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:00:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:00:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8061MB free_disk=25.088027954101562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Applying migration context for instance c575033f-89b0-4e8e-a827-50c8ab260713 as it has an incoming, in-progress migration 9d784d79-5326-4901-9bec-570451ecf5b7. Migration status is finished {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 15:00:58 user nova-compute[76870]: INFO nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating resource usage from migration 9d784d79-5326-4901-9bec-570451ecf5b7
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c1b032b7-20ca-49f7-9f5f-ce0632256594 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 1105dae2-5647-42a9-8a64-00947a5cd1c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Migration 9d784d79-5326-4901-9bec-570451ecf5b7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:00:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:00:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:00:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:00:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:00:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:00:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:00:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-changed-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Refreshing instance network info cache due to event network-changed-8da6a17f-3d65-49a6-b17d-576bd6320f22. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] Acquiring lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] Acquired lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Refreshing network info cache for port 8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updated VIF entry in instance network info cache for port 8da6a17f-3d65-49a6-b17d-576bd6320f22. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updating instance_info_cache with network_info: [{"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:01:00 user nova-compute[76870]: INFO nova.compute.manager [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Terminating instance
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-576109d4-6a00-4e69-a666-c44373f40b93 req-08955544-738e-4836-a62b-77d0daf5cbf0 service nova] Releasing lock "refresh_cache-1105dae2-5647-42a9-8a64-00947a5cd1c8" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-89ca629f-726e-4b5f-826e-d94a926cff4e req-91cdadc8-b577-407e-9573-59c2d8b2bf7c service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-vif-unplugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-89ca629f-726e-4b5f-826e-d94a926cff4e req-91cdadc8-b577-407e-9573-59c2d8b2bf7c service nova] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-89ca629f-726e-4b5f-826e-d94a926cff4e req-91cdadc8-b577-407e-9573-59c2d8b2bf7c service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-89ca629f-726e-4b5f-826e-d94a926cff4e req-91cdadc8-b577-407e-9573-59c2d8b2bf7c service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-89ca629f-726e-4b5f-826e-d94a926cff4e req-91cdadc8-b577-407e-9573-59c2d8b2bf7c service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] No waiting events found dispatching network-vif-unplugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-89ca629f-726e-4b5f-826e-d94a926cff4e req-91cdadc8-b577-407e-9573-59c2d8b2bf7c service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-vif-unplugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [{"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:01 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Instance destroyed successfully.
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.objects.instance [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'resources' on Instance uuid 1105dae2-5647-42a9-8a64-00947a5cd1c8 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-117464407',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-117464407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-117464407',id=38,image_ref='7cb5f892-5cde-4998-b6ce-2f83279acf51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOChdAOtT4EArN4tzkX1dp5t3m2hnl2yQtt35Baz7GFPC88z3wuRsw7LdDfs3o9iHVzdZh2QjY1VrWcqOoe1PlD4TEYrTUEsBFJov2qiJ3LK54ijO8o7Uh4yN0bXm9meWw==',key_name='tempest-keypair-1355158532',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-eaalf618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2023237776',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=1105dae2-5647-42a9-8a64-00947a5cd1c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "address": "fa:16:3e:a8:16:a8", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da6a17f-3d", "ovs_interfaceid": "8da6a17f-3d65-49a6-b17d-576bd6320f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_vif [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8da6a17f-3d, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8531cd0-2001-4b8d-a7c9-4a1c5573b1ae) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:01 user nova-compute[76870]: INFO os_vif [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:16:a8,bridge_name='br-int',has_traffic_filtering=True,id=8da6a17f-3d65-49a6-b17d-576bd6320f22,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da6a17f-3d')
Oct 20 15:01:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlVBIPqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:01:01 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad69428a-4709-4bc7-b1b7-0d06ebbaa7ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:01:01 user nova-compute[76870]: No targets found.
Oct 20 15:01:01 user nova-compute[76870]: iSNS:
Oct 20 15:01:01 user nova-compute[76870]: No targets found.
Oct 20 15:01:01 user nova-compute[76870]: STATIC:
Oct 20 15:01:01 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:01:01 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:01:01 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:01:01 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f
Oct 20 15:01:01 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:01:01 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:01:01 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6
Oct 20 15:01:01 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:01:01 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:01:01 user nova-compute[76870]: FIRMWARE:
Oct 20 15:01:01 user nova-compute[76870]: No targets found.
Oct 20 15:01:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:01:01 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:01:01 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[634db792-1cf1-4e9b-8b89-bcfd215372c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96d89f5-00a3-43a9-bda7-c23319ac2b1b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:01:01 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:01:01 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:01:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:01:01 user nova-compute[76870]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f (non-flash)
Oct 20 15:01:01 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:01:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c207130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3841844-4a06-446e-9de3-15c06faed71f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e4c62-c9de-4f52-9f9d-f797adfab7d0]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c48364e-e765-40c3-b69f-e162e523aef6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c16c2f-6a3b-48a8-843c-98fdbd110f36]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a56464-c5e2-4e62-a1cd-e64064bac779]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6d8e50-2457-42a2-a189-92d93eb03d79]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260]
Oct 20 15:01:01 user nova-compute[76870]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f, portal: 172.16.0.220,3260] successful.
Oct 20 15:01:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:01:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20a7e11-c1bc-48f8-95b1-50455845f85f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d83f16-2427-4554-8e79-94632a79a858]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== disconnect_volume: return (307ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:01:02 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Deleting instance files /opt/stack/data/nova/instances/1105dae2-5647-42a9-8a64-00947a5cd1c8_del
Oct 20 15:01:02 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Deletion of /opt/stack/data/nova/instances/1105dae2-5647-42a9-8a64-00947a5cd1c8_del complete
Oct 20 15:01:02 user nova-compute[76870]: INFO nova.compute.manager [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 15:01:02 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:01:02 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:01:02 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Took 0.90 seconds to deallocate network for instance.
Oct 20 15:01:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-b58a71ad-3027-4ee6-bebd-f11d8221eb88 req-b428e946-4fc8-4a59-a09e-668b77453a49 service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-vif-deleted-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-1fb5a29f-2786-4382-bd5f-6cca25502bc5 req-1c84e0a8-7ceb-459e-a438-3cd8eacf95cc service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received event network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1fb5a29f-2786-4382-bd5f-6cca25502bc5 req-1c84e0a8-7ceb-459e-a438-3cd8eacf95cc service nova] Acquiring lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1fb5a29f-2786-4382-bd5f-6cca25502bc5 req-1c84e0a8-7ceb-459e-a438-3cd8eacf95cc service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1fb5a29f-2786-4382-bd5f-6cca25502bc5 req-1c84e0a8-7ceb-459e-a438-3cd8eacf95cc service nova] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-1fb5a29f-2786-4382-bd5f-6cca25502bc5 req-1c84e0a8-7ceb-459e-a438-3cd8eacf95cc service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] No waiting events found dispatching network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:01:03 user nova-compute[76870]: WARNING nova.compute.manager [req-1fb5a29f-2786-4382-bd5f-6cca25502bc5 req-1c84e0a8-7ceb-459e-a438-3cd8eacf95cc service nova] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Received unexpected event network-vif-plugged-8da6a17f-3d65-49a6-b17d-576bd6320f22 for instance with vm_state active and task_state deleting.
Oct 20 15:01:03 user nova-compute[76870]: INFO nova.compute.manager [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Took 0.93 seconds to detach 1 volumes for instance.
Oct 20 15:01:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 1105dae2-5647-42a9-8a64-00947a5cd1c8] Deleting volume: c20a7e11-c1bc-48f8-95b1-50455845f85f {{(pid=76870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 15:01:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:04 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:01:04 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:01:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:04 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Deleted allocations for instance 1105dae2-5647-42a9-8a64-00947a5cd1c8
Oct 20 15:01:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-1b707ed2-8aec-4581-a737-eee8baad0ce4 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "1105dae2-5647-42a9-8a64-00947a5cd1c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.591s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:10 user nova-compute[76870]: INFO nova.compute.manager [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Terminating instance
Oct 20 15:01:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-43c12dac-51d6-4fcf-886f-e444d439a81c req-b63f37b1-1d69-4f0d-96fc-249c5661ef9a service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-43c12dac-51d6-4fcf-886f-e444d439a81c req-b63f37b1-1d69-4f0d-96fc-249c5661ef9a service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-43c12dac-51d6-4fcf-886f-e444d439a81c req-b63f37b1-1d69-4f0d-96fc-249c5661ef9a service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-43c12dac-51d6-4fcf-886f-e444d439a81c req-b63f37b1-1d69-4f0d-96fc-249c5661ef9a service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-43c12dac-51d6-4fcf-886f-e444d439a81c req-b63f37b1-1d69-4f0d-96fc-249c5661ef9a service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-43c12dac-51d6-4fcf-886f-e444d439a81c req-b63f37b1-1d69-4f0d-96fc-249c5661ef9a service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-unplugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:01:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Instance destroyed successfully.
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.objects.instance [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'resources' on Instance uuid 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-769182693',display_name='tempest-ServerRescueNegativeTestJSON-server-769182693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-769182693',id=34,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmwSXYUEx9rW06xk5OHVP9H4NAKV86Uc1mZEe5OgDloTx9OpGHGlxWbyQRrHTV0KLavBACdEuz1vPc4e6gVv4AVUrz8apZuHx1WdzOw5Z5pQFSiZG67ape/agVWm39ucQ==',key_name='tempest-keypair-519323342',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-f7q8ucql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdd157499df5446e8c082732e1fbd278',uuid=6f7587fb-f5b3-4b07-b5d7-dead87bbd49d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "address": "fa:16:3e:1d:73:4a", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9c95d3-de", "ovs_interfaceid": "cc9c95d3-deb4-493d-b45f-c0c2205d8c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG os_vif [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc9c95d3-de, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dbb5bd5-d4a7-4eaf-975e-dda23b742647) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:11 user nova-compute[76870]: INFO os_vif [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:73:4a,bridge_name='br-int',has_traffic_filtering=True,id=cc9c95d3-deb4-493d-b45f-c0c2205d8c46,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9c95d3-de')
Oct 20 15:01:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Deleting instance files /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d_del
Oct 20 15:01:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Deletion of /opt/stack/data/nova/instances/6f7587fb-f5b3-4b07-b5d7-dead87bbd49d_del complete
Oct 20 15:01:11 user nova-compute[76870]: INFO nova.compute.manager [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 15:01:11 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:01:11 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:01:12 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:01:12 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Took 0.97 seconds to deallocate network for instance.
Oct 20 15:01:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:12 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:01:12 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:01:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:12 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Deleted allocations for instance 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d
Oct 20 15:01:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0634853c-48e5-4754-a314-d3ee0b989f0a tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] Acquiring lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] Lock "6f7587fb-f5b3-4b07-b5d7-dead87bbd49d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] No waiting events found dispatching network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:01:13 user nova-compute[76870]: WARNING nova.compute.manager [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received unexpected event network-vif-plugged-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 for instance with vm_state deleted and task_state None.
Oct 20 15:01:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-e1b170b1-acc1-4442-8806-9a41252d65c8 req-8cec1da8-35f2-4801-9768-a0cf72d5ac56 service nova] [instance: 6f7587fb-f5b3-4b07-b5d7-dead87bbd49d] Received event network-vif-deleted-cc9c95d3-deb4-493d-b45f-c0c2205d8c46 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:01:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:01:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:01:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:01:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:01:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:01:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:01:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:01:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:01:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:01:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:01:49 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:01:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:01:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:55 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:01:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:01:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:01:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:01:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8245MB free_disk=25.087081909179688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Applying migration context for instance c575033f-89b0-4e8e-a827-50c8ab260713 as it has an incoming, in-progress migration 9d784d79-5326-4901-9bec-570451ecf5b7. Migration status is finished {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 15:01:58 user nova-compute[76870]: INFO nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating resource usage from migration 9d784d79-5326-4901-9bec-570451ecf5b7
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c1b032b7-20ca-49f7-9f5f-ce0632256594 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Migration 9d784d79-5326-4901-9bec-570451ecf5b7 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:01:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:00 user nova-compute[76870]: INFO nova.compute.manager [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Terminating instance
Oct 20 15:02:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-330dd040-ea41-4fe1-b09b-9b28d2c2f29a req-e42076ba-0c3a-4060-9017-45eacf187f43 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-vif-unplugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-330dd040-ea41-4fe1-b09b-9b28d2c2f29a req-e42076ba-0c3a-4060-9017-45eacf187f43 service nova] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-330dd040-ea41-4fe1-b09b-9b28d2c2f29a req-e42076ba-0c3a-4060-9017-45eacf187f43 service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-330dd040-ea41-4fe1-b09b-9b28d2c2f29a req-e42076ba-0c3a-4060-9017-45eacf187f43 service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-330dd040-ea41-4fe1-b09b-9b28d2c2f29a req-e42076ba-0c3a-4060-9017-45eacf187f43 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] No waiting events found dispatching network-vif-unplugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-330dd040-ea41-4fe1-b09b-9b28d2c2f29a req-e42076ba-0c3a-4060-9017-45eacf187f43 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-vif-unplugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Instance destroyed successfully.
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'resources' on Instance uuid c1b032b7-20ca-49f7-9f5f-ce0632256594 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-572892426',display_name='tempest-TestVolumeBootPattern-volume-backed-server-572892426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-572892426',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1xcTtVho5Fcra54xRFIbsHTfmtN3hbQaDymM/ymWEn5BcuoT1+x3RGY+vv/h7hA6IhCZEBTIUYUpMqskOYOq30ZokVKX5APZhyW+WuDJt9Z6BmPiURg1uWG5/gusunDg==',key_name='tempest-keypair-2139144007',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-1004m700',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=c1b032b7-20ca-49f7-9f5f-ce0632256594,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_vif [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98255487-c8, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0a2db97-55a6-49a7-a2e8-13421d667c6e) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:01 user nova-compute[76870]: INFO os_vif [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:27:64,bridge_name='br-int',has_traffic_filtering=True,id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98255487-c8')
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfAxqWZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:02:01 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f625dac-2eca-4586-bfa3-c8e83411c9d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:02:01 user nova-compute[76870]: No targets found.
Oct 20 15:02:01 user nova-compute[76870]: iSNS:
Oct 20 15:02:01 user nova-compute[76870]: No targets found.
Oct 20 15:02:01 user nova-compute[76870]: STATIC:
Oct 20 15:02:01 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:02:01 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:02:01 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:02:01 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6
Oct 20 15:02:01 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:02:01 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:02:01 user nova-compute[76870]: FIRMWARE:
Oct 20 15:02:01 user nova-compute[76870]: No targets found.
Oct 20 15:02:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:02:01 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:02:01 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4d8f6-c0a0-4441-b91a-a104a287d267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68f48f6-d440-4f18-937e-e624d6e2c271]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:02:01 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:02:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 (non-flash)
Oct 20 15:02:01 user nova-compute[76870]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:02:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8497760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a894f-4a46-4a00-a577-a1a71b74d3bf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1497f391-3f5b-4355-8d25-7cc478904276]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbfd061-2a75-40bc-b0fd-dc3a6f5d28ea]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7382257f-941b-48b9-be6c-6f4d2e4379c9]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23036343539336138', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_20c94da6', '/dev/disk/by-id/scsi-1SCST_BIO20c94da6-064593a844a97be2') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 15:02:01 user nova-compute[76870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23036343539336138
Oct 20 15:02:01 user nova-compute[76870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_20c94da6
Oct 20 15:02:01 user nova-compute[76870]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO20c94da6-064593a844a97be2
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dcd16a-ad8c-44b2-b2ec-9f6b3235ebf3]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a1bef-e12d-413d-a839-9aa5e93f8da8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a079a-35c4-4849-8d4b-4b7f5f9482dc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260]
Oct 20 15:02:01 user nova-compute[76870]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6, portal: 172.16.0.220,3260] successful.
Oct 20 15:02:01 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad85255-e8d3-473b-b4a0-18b30ec30db6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== disconnect_volume: return (302ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:02:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:02:01 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Deleting instance files /opt/stack/data/nova/instances/c1b032b7-20ca-49f7-9f5f-ce0632256594_del
Oct 20 15:02:01 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Deletion of /opt/stack/data/nova/instances/c1b032b7-20ca-49f7-9f5f-ce0632256594_del complete
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating instance_info_cache with network_info: [{"id": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "address": "fa:16:3e:b1:27:64", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98255487-c8", "ovs_interfaceid": "98255487-c8b3-4c47-ae06-6ee3b9a0acd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c1b032b7-20ca-49f7-9f5f-ce0632256594" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:02 user nova-compute[76870]: INFO nova.compute.manager [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 20 15:02:02 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-301cdc4d-05d4-4c33-a4d7-b2a2d382b9be req-d9761d28-a901-4c52-bc04-1e9fd184fb06 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-vif-deleted-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:02 user nova-compute[76870]: INFO nova.compute.manager [req-301cdc4d-05d4-4c33-a4d7-b2a2d382b9be req-d9761d28-a901-4c52-bc04-1e9fd184fb06 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Neutron deleted interface 98255487-c8b3-4c47-ae06-6ee3b9a0acd8; detaching it from the instance and deleting it from the info cache
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-301cdc4d-05d4-4c33-a4d7-b2a2d382b9be req-d9761d28-a901-4c52-bc04-1e9fd184fb06 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:02:02 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Took 0.82 seconds to deallocate network for instance.
Oct 20 15:02:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-301cdc4d-05d4-4c33-a4d7-b2a2d382b9be req-d9761d28-a901-4c52-bc04-1e9fd184fb06 service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Detach interface failed, port_id=98255487-c8b3-4c47-ae06-6ee3b9a0acd8, reason: Instance c1b032b7-20ca-49f7-9f5f-ce0632256594 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-271b4d6b-f450-4b9d-8fe7-eec0608f4603 req-da3f0e50-bea4-4c86-b6c9-700a4148dc4f service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received event network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-271b4d6b-f450-4b9d-8fe7-eec0608f4603 req-da3f0e50-bea4-4c86-b6c9-700a4148dc4f service nova] Acquiring lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-271b4d6b-f450-4b9d-8fe7-eec0608f4603 req-da3f0e50-bea4-4c86-b6c9-700a4148dc4f service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-271b4d6b-f450-4b9d-8fe7-eec0608f4603 req-da3f0e50-bea4-4c86-b6c9-700a4148dc4f service nova] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-271b4d6b-f450-4b9d-8fe7-eec0608f4603 req-da3f0e50-bea4-4c86-b6c9-700a4148dc4f service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] No waiting events found dispatching network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:02:03 user nova-compute[76870]: WARNING nova.compute.manager [req-271b4d6b-f450-4b9d-8fe7-eec0608f4603 req-da3f0e50-bea4-4c86-b6c9-700a4148dc4f service nova] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Received unexpected event network-vif-plugged-98255487-c8b3-4c47-ae06-6ee3b9a0acd8 for instance with vm_state active and task_state deleting.
Oct 20 15:02:03 user nova-compute[76870]: INFO nova.compute.manager [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 15:02:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: c1b032b7-20ca-49f7-9f5f-ce0632256594] Deleting volume: 2fd2e14a-4f82-4ad1-9c1b-b8ceec4b59b6 {{(pid=76870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:04 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:02:04 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:02:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:04 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Deleted allocations for instance c1b032b7-20ca-49f7-9f5f-ce0632256594
Oct 20 15:02:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f5437732-ef5b-4185-bdf6-49d46c0a4dc8 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "c1b032b7-20ca-49f7-9f5f-ce0632256594" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.340s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Going to confirm migration 2 {{(pid=76870) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'info_cache' on Instance uuid c575033f-89b0-4e8e-a827-50c8ab260713 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:02:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'migration_context' on Instance uuid c575033f-89b0-4e8e-a827-50c8ab260713 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG nova.objects.base [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Object Instance<c575033f-89b0-4e8e-a827-50c8ab260713> lazy-loaded attributes: info_cache,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.269s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:06 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Deleted allocation for migration 9d784d79-5326-4901-9bec-570451ecf5b7
Oct 20 15:02:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-42f0dbfd-9c13-490f-bb7a-13e74c4c9643 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.217s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:02:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:02:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-changed-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Refreshing instance network info cache due to event network-changed-425cd9d9-f423-4069-b010-00db8691b7bf. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] Acquiring lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] Acquired lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Refreshing network info cache for port 425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'flavor' on Instance uuid ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:02:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Ignoring supplied device name: /dev/vdb
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:28 user nova-compute[76870]: INFO nova.compute.manager [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Attaching volume 069c4198-0fe6-4f30-8cc7-62a295b7f511 to /dev/vdb
Oct 20 15:02:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updated VIF entry in instance network info cache for port 425cd9d9-f423-4069-b010-00db8691b7bf. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updating instance_info_cache with network_info: [{"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-135b369e-32be-49e3-90ec-a93eae480452 req-8750ce8b-f487-487e-88ca-1df19299ecc0 service nova] Releasing lock "refresh_cache-ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG os_brick.utils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e1518-5828-48de-9ca0-7bc15aeea5b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b500f26-1053-4b72-9342-0ca6c485d9e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8fac0-9dd1-4de7-87fd-79d6be088ee4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[718fd6c1-e8f1-47f1-88b6-f6e3c4eabe93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:02:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:02:29 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:02:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e3b7da-2f21-4f4d-98fa-3a2ef099b51f]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:02:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:02:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:02:29 user nova-compute[76870]: DEBUG os_brick.utils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:02:29 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updating existing volume attachment record: 1ef3bbd8-8298-4274-a443-6512785ae4a9 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:02:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:31 user nova-compute[76870]: INFO nova.compute.manager [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Terminating instance
Oct 20 15:02:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-2238e07a-eeeb-4e4f-9614-f727ff9553f0 req-fed1f08e-9ebc-426a-823b-9ba73e3b1209 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2238e07a-eeeb-4e4f-9614-f727ff9553f0 req-fed1f08e-9ebc-426a-823b-9ba73e3b1209 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2238e07a-eeeb-4e4f-9614-f727ff9553f0 req-fed1f08e-9ebc-426a-823b-9ba73e3b1209 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2238e07a-eeeb-4e4f-9614-f727ff9553f0 req-fed1f08e-9ebc-426a-823b-9ba73e3b1209 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-2238e07a-eeeb-4e4f-9614-f727ff9553f0 req-fed1f08e-9ebc-426a-823b-9ba73e3b1209 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-2238e07a-eeeb-4e4f-9614-f727ff9553f0 req-fed1f08e-9ebc-426a-823b-9ba73e3b1209 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-unplugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:02:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Instance destroyed successfully.
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.objects.instance [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'resources' on Instance uuid 85c1fb0e-ae51-453e-9bbc-7f86370d44d4 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397882495',display_name='tempest-ServerRescueNegativeTestJSON-server-1397882495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397882495',id=28,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-cdxtuonh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:47:45Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=85c1fb0e-ae51-453e-9bbc-7f86370d44d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "49af51a5-d47b-4bb9-842f-105bac22dae3", "address": "fa:16:3e:7f:28:25", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49af51a5-d4", "ovs_interfaceid": "49af51a5-d47b-4bb9-842f-105bac22dae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG os_vif [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49af51a5-d4, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5063f1c-ef26-4731-a983-a3919a240d1a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:32 user nova-compute[76870]: INFO os_vif [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:28:25,bridge_name='br-int',has_traffic_filtering=True,id=49af51a5-d47b-4bb9-842f-105bac22dae3,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49af51a5-d4')
Oct 20 15:02:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Deleting instance files /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4_del
Oct 20 15:02:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Deletion of /opt/stack/data/nova/instances/85c1fb0e-ae51-453e-9bbc-7f86370d44d4_del complete
Oct 20 15:02:32 user nova-compute[76870]: INFO nova.compute.manager [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 15:02:32 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:02:32 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:02:33 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:02:33 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Took 0.69 seconds to deallocate network for instance.
Oct 20 15:02:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:33 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a3ab8bf-75b9-4e3c-a7e6-10ea01e5691e req-6127692d-9169-452a-a02b-ba340da2bf9c service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-deleted-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:33 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:02:33 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:02:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:33 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Deleted allocations for instance 85c1fb0e-ae51-453e-9bbc-7f86370d44d4
Oct 20 15:02:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-048725d1-7ad4-426a-92a4-86b7a06e1391 tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-2124cca5-ceac-471c-bc2c-8755ee3eff0a req-77b4e63a-5220-49f2-9a0b-79515d867964 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:02:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2124cca5-ceac-471c-bc2c-8755ee3eff0a req-77b4e63a-5220-49f2-9a0b-79515d867964 service nova] Acquiring lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2124cca5-ceac-471c-bc2c-8755ee3eff0a req-77b4e63a-5220-49f2-9a0b-79515d867964 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2124cca5-ceac-471c-bc2c-8755ee3eff0a req-77b4e63a-5220-49f2-9a0b-79515d867964 service nova] Lock "85c1fb0e-ae51-453e-9bbc-7f86370d44d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-2124cca5-ceac-471c-bc2c-8755ee3eff0a req-77b4e63a-5220-49f2-9a0b-79515d867964 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] No waiting events found dispatching network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:02:34 user nova-compute[76870]: WARNING nova.compute.manager [req-2124cca5-ceac-471c-bc2c-8755ee3eff0a req-77b4e63a-5220-49f2-9a0b-79515d867964 service nova] [instance: 85c1fb0e-ae51-453e-9bbc-7f86370d44d4] Received unexpected event network-vif-plugged-49af51a5-d47b-4bb9-842f-105bac22dae3 for instance with vm_state deleted and task_state None.
Oct 20 15:02:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDfCtbNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:02:44 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:02:44 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:02:44 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd7ca3-46e7-40ec-9a83-be4449f07e44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:02:44 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b3d4ab-827e-436e-8757-26a2bac97255]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511] added
Oct 20 15:02:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8c8a91-a813-4872-8f5b-350525f82de2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a3106-b8de-4755-a7b7-4734cda85190]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDfCtbNq {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDfCtbNq" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f487c761-fa59-4d46-8de8-0a44093453ce]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jDfCtbNq'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b35e137-19db-4632-9d3a-c01ec137dfee]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d92512-6996-48cd-9036-af03b2b85840]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:02:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:02:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4351bd2c-1370-46ad-9ab5-be8babe35b8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260]
Oct 20 15:02:44 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260] successful.
Oct 20 15:02:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e10eb-10f9-42d4-8bd1-3e911d979922]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588c96e-c4ff-47b4-9d56-181a22403ac7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:02:44 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:02:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:02:44 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:02:44 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:02:44 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[363fab0c-0b5a-47e5-8c10-16d0ebb5fdb4]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:02:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDfCtbNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23836336636333439', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836336636333439', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG nova.objects.instance [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'flavor' on Instance uuid ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:02:46 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:02:46 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:02:46 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:02:46 user nova-compute[76870]:   <serial>069c4198-0fe6-4f30-8cc7-62a295b7f511</serial>
Oct 20 15:02:46 user nova-compute[76870]: </disk>
Oct 20 15:02:46 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] No VIF found with MAC fa:16:3e:1f:58:4e, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:02:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-f9a982c7-67bd-4b86-a4a9-a01042b8ced9 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.759s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:48 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:02:49 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:02:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:02:56 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:02:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:02:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.11310577392578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 0ef00916-b444-490b-a221-81f18276baaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:02:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:03:00 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:03:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [{"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:03:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:03:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:03:09 user nova-compute[76870]: INFO nova.compute.claims [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Claim successful on node user
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.network.neutron [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:03:09 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.policy [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '407faf0fe9f44219a2d0580e9819f8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710a95fd9def4ae08263d4cdafbdffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:03:09 user nova-compute[76870]: INFO nova.virt.block_device [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Booting with volume 5a37a1df-33b8-4532-bd03-1c0698ed8c32 at /dev/vda
Oct 20 15:03:09 user nova-compute[76870]: DEBUG os_brick.utils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70db32-25dc-452a-a52b-81e7fc74721e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7953523d-3f47-4554-8e3e-5c5cff73ce2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a554103-b8a4-49eb-ae64-6eaa7f269195]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b2644a-b142-4d82-be83-dba7a1166642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:03:09 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:03:09 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[00876d29-2576-46c6-aa03-1c13cf653307]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG os_brick.utils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:03:09 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updating existing volume attachment record: 64600373-055b-4734-bd1c-14e3b37ee2d6 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:03:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:10 user nova-compute[76870]: DEBUG nova.network.neutron [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Successfully created port: 074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Successfully updated port: 074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquired lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-changed-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Refreshing instance network info cache due to event network-changed-074b89ea-7260-46e2-999e-dcafdd257b88. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] Acquiring lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updating instance_info_cache with network_info: [{"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Releasing lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Instance network_info: |[{"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] Acquired lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Refreshing network info cache for port 074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updated VIF entry in instance network info cache for port 074b89ea-7260-46e2-999e-dcafdd257b88. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG nova.network.neutron [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updating instance_info_cache with network_info: [{"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c3ec7a94-bd78-4794-9d14-3a438023c876 req-e6f77541-8723-4edf-a085-2840a11d7e44 service nova] Releasing lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:03:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "0ef00916-b444-490b-a221-81f18276baaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:22 user nova-compute[76870]: INFO nova.compute.manager [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Terminating instance
Oct 20 15:03:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-41eaccb7-6828-4710-8f3b-d609d88f59fe req-aae63909-a046-4130-8582-0edef4845077 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-41eaccb7-6828-4710-8f3b-d609d88f59fe req-aae63909-a046-4130-8582-0edef4845077 service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-41eaccb7-6828-4710-8f3b-d609d88f59fe req-aae63909-a046-4130-8582-0edef4845077 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-41eaccb7-6828-4710-8f3b-d609d88f59fe req-aae63909-a046-4130-8582-0edef4845077 service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-41eaccb7-6828-4710-8f3b-d609d88f59fe req-aae63909-a046-4130-8582-0edef4845077 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG nova.compute.manager [req-41eaccb7-6828-4710-8f3b-d609d88f59fe req-aae63909-a046-4130-8582-0edef4845077 service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-unplugged-845e035b-f600-4801-91e4-da31116e9430 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:03:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:23 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Instance destroyed successfully.
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.objects.instance [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lazy-loading 'resources' on Instance uuid 0ef00916-b444-490b-a221-81f18276baaa {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107637266',display_name='tempest-ServerRescueNegativeTestJSON-server-1107637266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107637266',id=27,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb2d2209f464235949db2d48ec8e2eb',ramdisk_id='',reservation_id='r-72q7sghr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1475360384',owner_user_name='tempest-ServerRescueNegativeTestJSON-1475360384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:52:32Z,user_data=None,user_id='fdd157499df5446e8c082732e1fbd278',uuid=0ef00916-b444-490b-a221-81f18276baaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converting VIF {"id": "845e035b-f600-4801-91e4-da31116e9430", "address": "fa:16:3e:21:5a:d1", "network": {"id": "86b24a2f-6c79-4a86-bfaa-601b8a5dba4d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1499043714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb2d2209f464235949db2d48ec8e2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845e035b-f6", "ovs_interfaceid": "845e035b-f600-4801-91e4-da31116e9430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG os_vif [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap845e035b-f6, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=290b194d-ae1c-4495-83be-991ab8f6f985) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:23 user nova-compute[76870]: INFO os_vif [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:5a:d1,bridge_name='br-int',has_traffic_filtering=True,id=845e035b-f600-4801-91e4-da31116e9430,network=Network(86b24a2f-6c79-4a86-bfaa-601b8a5dba4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845e035b-f6')
Oct 20 15:03:23 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Deleting instance files /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa_del
Oct 20 15:03:23 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Deletion of /opt/stack/data/nova/instances/0ef00916-b444-490b-a221-81f18276baaa_del complete
Oct 20 15:03:23 user nova-compute[76870]: INFO nova.compute.manager [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 15:03:23 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:23 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Took 0.55 seconds to deallocate network for instance.
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-640ad4ad-57d1-43dd-b4a2-7011a2f41f2c req-1514a9c9-8843-4ba2-8326-9aba1755555c service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-deleted-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:23 user nova-compute[76870]: INFO nova.compute.manager [req-640ad4ad-57d1-43dd-b4a2-7011a2f41f2c req-1514a9c9-8843-4ba2-8326-9aba1755555c service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Neutron deleted interface 845e035b-f600-4801-91e4-da31116e9430; detaching it from the instance and deleting it from the info cache
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.network.neutron [req-640ad4ad-57d1-43dd-b4a2-7011a2f41f2c req-1514a9c9-8843-4ba2-8326-9aba1755555c service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-640ad4ad-57d1-43dd-b4a2-7011a2f41f2c req-1514a9c9-8843-4ba2-8326-9aba1755555c service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Detach interface failed, port_id=845e035b-f600-4801-91e4-da31116e9430, reason: Instance 0ef00916-b444-490b-a221-81f18276baaa could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:24 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Deleted allocations for instance 0ef00916-b444-490b-a221-81f18276baaa
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-511966c4-75d0-4419-b67b-1651828bc19b tempest-ServerRescueNegativeTestJSON-1475360384 tempest-ServerRescueNegativeTestJSON-1475360384-project-member] Lock "0ef00916-b444-490b-a221-81f18276baaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-95ab582f-4499-489e-8832-f8cf10659faf req-90e07068-847f-48b8-92b0-4b238eb0664b service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-95ab582f-4499-489e-8832-f8cf10659faf req-90e07068-847f-48b8-92b0-4b238eb0664b service nova] Acquiring lock "0ef00916-b444-490b-a221-81f18276baaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-95ab582f-4499-489e-8832-f8cf10659faf req-90e07068-847f-48b8-92b0-4b238eb0664b service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-95ab582f-4499-489e-8832-f8cf10659faf req-90e07068-847f-48b8-92b0-4b238eb0664b service nova] Lock "0ef00916-b444-490b-a221-81f18276baaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-95ab582f-4499-489e-8832-f8cf10659faf req-90e07068-847f-48b8-92b0-4b238eb0664b service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] No waiting events found dispatching network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:03:24 user nova-compute[76870]: WARNING nova.compute.manager [req-95ab582f-4499-489e-8832-f8cf10659faf req-90e07068-847f-48b8-92b0-4b238eb0664b service nova] [instance: 0ef00916-b444-490b-a221-81f18276baaa] Received unexpected event network-vif-plugged-845e035b-f600-4801-91e4-da31116e9430 for instance with vm_state deleted and task_state None.
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:03:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Creating image(s)
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Ensure instance console log exists: /opt/stack/data/nova/instances/3b919e78-e130-4299-8b92-e33dc028c6ef/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Start _get_guest_xml network_info=[{"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '64600373-055b-4734-bd1c-14e3b37ee2d6', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b919e78-e130-4299-8b92-e33dc028c6ef', 'attached_at': '', 'detached_at': '', 'volume_id': '5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'serial': '5a37a1df-33b8-4532-bd03-1c0698ed8c32'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:03:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:03:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:03:27 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:03:27 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:03:27 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c537f721-4d39-4bfc-876f-d99d846bb7ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:03:27 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[010dddfd-cbe2-4796-83c2-71e115ca3acb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32] added
Oct 20 15:03:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5955175e-2e8c-4cd8-889b-3802accefdbc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aab4dcc-156a-4daa-a7d0-043ddb6f00d4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZOrJEUHy {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZOrJEUHy" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80acf7cb-36bc-47de-bbe2-d1422fce6265]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZOrJEUHy'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad6e590-75cb-420b-98c6-3995cc8cfdc3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[019979ee-cc55-4555-8578-074af3dee6ac]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:27 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:03:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:27 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:03:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89fece-f29d-4a22-99f5-34e1fd2d1dd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]
Oct 20 15:03:27 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.
Oct 20 15:03:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e29a9fd-4fb0-4eb1-b091-8b02137b6282]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d637da-e192-422c-9c07-d130a8efe92d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:27 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:03:27 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:03:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:27 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:03:27 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:03:27 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f151d7-6efa-4442-9cd3-e69021241fd2]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:27 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23934663961383239', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663961383239', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1165266410',display_name='tempest-TestVolumeBootPattern-server-1165266410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1165266410',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-1b3f7svg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:03:10Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=3b919e78-e130-4299-8b92-e33dc028c6ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b919e78-e130-4299-8b92-e33dc028c6ef {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:03:28 user nova-compute[76870]:   <uuid>3b919e78-e130-4299-8b92-e33dc028c6ef</uuid>
Oct 20 15:03:28 user nova-compute[76870]:   <name>instance-00000028</name>
Oct 20 15:03:28 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:03:28 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:03:28 user nova-compute[76870]:   <metadata>
Oct 20 15:03:28 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:03:28 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:03:28 user nova-compute[76870]:       <nova:name>tempest-TestVolumeBootPattern-server-1165266410</nova:name>
Oct 20 15:03:28 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:03:27</nova:creationTime>
Oct 20 15:03:28 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:03:28 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:03:28 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:03:28 user nova-compute[76870]:       <nova:owner>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:user uuid="407faf0fe9f44219a2d0580e9819f8ec">tempest-TestVolumeBootPattern-2023237776-project-member</nova:user>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:project uuid="710a95fd9def4ae08263d4cdafbdffd3">tempest-TestVolumeBootPattern-2023237776</nova:project>
Oct 20 15:03:28 user nova-compute[76870]:       </nova:owner>
Oct 20 15:03:28 user nova-compute[76870]:       <nova:ports>
Oct 20 15:03:28 user nova-compute[76870]:         <nova:port uuid="074b89ea-7260-46e2-999e-dcafdd257b88">
Oct 20 15:03:28 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 15:03:28 user nova-compute[76870]:         </nova:port>
Oct 20 15:03:28 user nova-compute[76870]:       </nova:ports>
Oct 20 15:03:28 user nova-compute[76870]:     </nova:instance>
Oct 20 15:03:28 user nova-compute[76870]:   </metadata>
Oct 20 15:03:28 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:03:28 user nova-compute[76870]:     <system>
Oct 20 15:03:28 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:03:28 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:03:28 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:03:28 user nova-compute[76870]:       <entry name="serial">3b919e78-e130-4299-8b92-e33dc028c6ef</entry>
Oct 20 15:03:28 user nova-compute[76870]:       <entry name="uuid">3b919e78-e130-4299-8b92-e33dc028c6ef</entry>
Oct 20 15:03:28 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:03:28 user nova-compute[76870]:     </system>
Oct 20 15:03:28 user nova-compute[76870]:   </sysinfo>
Oct 20 15:03:28 user nova-compute[76870]:   <os>
Oct 20 15:03:28 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:03:28 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:03:28 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:03:28 user nova-compute[76870]:   </os>
Oct 20 15:03:28 user nova-compute[76870]:   <features>
Oct 20 15:03:28 user nova-compute[76870]:     <acpi/>
Oct 20 15:03:28 user nova-compute[76870]:     <apic/>
Oct 20 15:03:28 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:03:28 user nova-compute[76870]:   </features>
Oct 20 15:03:28 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:03:28 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:03:28 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:03:28 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:03:28 user nova-compute[76870]:   </clock>
Oct 20 15:03:28 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:03:28 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:03:28 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:03:28 user nova-compute[76870]:   </cpu>
Oct 20 15:03:28 user nova-compute[76870]:   <devices>
Oct 20 15:03:28 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:03:28 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:03:28 user nova-compute[76870]:       <source dev="/dev/sdc"/>
Oct 20 15:03:28 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:03:28 user nova-compute[76870]:       <serial>5a37a1df-33b8-4532-bd03-1c0698ed8c32</serial>
Oct 20 15:03:28 user nova-compute[76870]:     </disk>
Oct 20 15:03:28 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:03:28 user nova-compute[76870]:       <mac address="fa:16:3e:46:ef:dd"/>
Oct 20 15:03:28 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:03:28 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:03:28 user nova-compute[76870]:       <target dev="tap074b89ea-72"/>
Oct 20 15:03:28 user nova-compute[76870]:     </interface>
Oct 20 15:03:28 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:03:28 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/3b919e78-e130-4299-8b92-e33dc028c6ef/console.log" append="off"/>
Oct 20 15:03:28 user nova-compute[76870]:     </serial>
Oct 20 15:03:28 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:03:28 user nova-compute[76870]:     <video>
Oct 20 15:03:28 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:03:28 user nova-compute[76870]:     </video>
Oct 20 15:03:28 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:03:28 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:03:28 user nova-compute[76870]:     </rng>
Oct 20 15:03:28 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:03:28 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:03:28 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:03:28 user nova-compute[76870]:     </memballoon>
Oct 20 15:03:28 user nova-compute[76870]:   </devices>
Oct 20 15:03:28 user nova-compute[76870]: </domain>
Oct 20 15:03:28 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1165266410',display_name='tempest-TestVolumeBootPattern-server-1165266410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1165266410',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-1b3f7svg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:03:10Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=3b919e78-e130-4299-8b92-e33dc028c6ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG os_vif [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45d1345b-da70-549b-ad71-8722a286bc06', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap074b89ea-72, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap074b89ea-72, col_values=(('qos', UUID('e9abff2e-5b03-425d-9063-96c2e855c679')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap074b89ea-72, col_values=(('external_ids', {'iface-id': '074b89ea-7260-46e2-999e-dcafdd257b88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ef:dd', 'vm-uuid': '3b919e78-e130-4299-8b92-e33dc028c6ef'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:28 user nova-compute[76870]: INFO os_vif [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72')
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:03:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No VIF found with MAC fa:16:3e:46:ef:dd, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-9e81c2ff-3121-40e1-b4dc-1ddf369fb605 req-a6c29f75-8a0a-4a76-a736-36ee1320b1b0 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9e81c2ff-3121-40e1-b4dc-1ddf369fb605 req-a6c29f75-8a0a-4a76-a736-36ee1320b1b0 service nova] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9e81c2ff-3121-40e1-b4dc-1ddf369fb605 req-a6c29f75-8a0a-4a76-a736-36ee1320b1b0 service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9e81c2ff-3121-40e1-b4dc-1ddf369fb605 req-a6c29f75-8a0a-4a76-a736-36ee1320b1b0 service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-9e81c2ff-3121-40e1-b4dc-1ddf369fb605 req-a6c29f75-8a0a-4a76-a736-36ee1320b1b0 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] No waiting events found dispatching network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:03:29 user nova-compute[76870]: WARNING nova.compute.manager [req-9e81c2ff-3121-40e1-b4dc-1ddf369fb605 req-a6c29f75-8a0a-4a76-a736-36ee1320b1b0 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received unexpected event network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 for instance with vm_state building and task_state spawning.
Oct 20 15:03:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:03:31 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Instance spawned successfully.
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:03:31 user nova-compute[76870]: INFO nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Took 4.94 seconds to spawn the instance on the hypervisor.
Oct 20 15:03:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:03:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-f453c011-d0e0-4a81-abc6-5b7afa77cd08 req-89b9a413-313d-4982-a054-0841b7c4c88c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f453c011-d0e0-4a81-abc6-5b7afa77cd08 req-89b9a413-313d-4982-a054-0841b7c4c88c service nova] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f453c011-d0e0-4a81-abc6-5b7afa77cd08 req-89b9a413-313d-4982-a054-0841b7c4c88c service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f453c011-d0e0-4a81-abc6-5b7afa77cd08 req-89b9a413-313d-4982-a054-0841b7c4c88c service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-f453c011-d0e0-4a81-abc6-5b7afa77cd08 req-89b9a413-313d-4982-a054-0841b7c4c88c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] No waiting events found dispatching network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:03:32 user nova-compute[76870]: WARNING nova.compute.manager [req-f453c011-d0e0-4a81-abc6-5b7afa77cd08 req-89b9a413-313d-4982-a054-0841b7c4c88c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received unexpected event network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 for instance with vm_state building and task_state spawning.
Oct 20 15:03:32 user nova-compute[76870]: INFO nova.compute.manager [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Took 22.81 seconds to build instance.
Oct 20 15:03:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-869f31d9-eb09-407f-aa3e-3180f95edcdf tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.915s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:34 user nova-compute[76870]: INFO nova.compute.manager [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Detaching volume 069c4198-0fe6-4f30-8cc7-62a295b7f511
Oct 20 15:03:34 user nova-compute[76870]: INFO nova.virt.block_device [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Attempting to driver detach volume 069c4198-0fe6-4f30-8cc7-62a295b7f511 from mountpoint /dev/vdb
Oct 20 15:03:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Attempting to detach device vdb from instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:03:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:03:34 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:03:34 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:03:34 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:03:34 user nova-compute[76870]:   <serial>069c4198-0fe6-4f30-8cc7-62a295b7f511</serial>
Oct 20 15:03:34 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:03:34 user nova-compute[76870]: </disk>
Oct 20 15:03:34 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:03:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully detached device vdb from instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 from the persistent domain config.
Oct 20 15:03:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:03:34 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:03:34 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:03:34 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:03:34 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:03:34 user nova-compute[76870]:   <serial>069c4198-0fe6-4f30-8cc7-62a295b7f511</serial>
Oct 20 15:03:34 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:03:34 user nova-compute[76870]: </disk>
Oct 20 15:03:34 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:03:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:03:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:03:49 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:03:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:55 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 is timed out.
Oct 20 15:03:55 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully detached device vdb from instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 from the live domain config.
Oct 20 15:03:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDfCtbNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:03:55 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f78fc-1e6f-4024-b95c-d0f63e33393e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:03:55 user nova-compute[76870]: No targets found.
Oct 20 15:03:55 user nova-compute[76870]: iSNS:
Oct 20 15:03:55 user nova-compute[76870]: No targets found.
Oct 20 15:03:55 user nova-compute[76870]: STATIC:
Oct 20 15:03:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:03:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:03:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:03:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511
Oct 20 15:03:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:03:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:03:55 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:03:55 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:03:55 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:03:55 user nova-compute[76870]: FIRMWARE:
Oct 20 15:03:55 user nova-compute[76870]: No targets found.
Oct 20 15:03:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:03:55 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:03:55 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7979173-5b55-4621-87be-d000aa268327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb0ccba-b698-416a-a328-436d5e8de333]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:55 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:03:55 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:03:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:55 user nova-compute[76870]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 (non-flash)
Oct 20 15:03:55 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:03:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c4c3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[483b7177-85eb-4721-af16-e7dae2281c64]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea19ec3-9084-4d35-a5b4-fcd176f9c18d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c5c41c-e7ea-4a2e-b6f5-119a18932044]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d674f8d5-7f64-4cda-93c6-6ad658d176e1]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e7ec1c-f22c-4b50-b68b-26b7ca4ba9c4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bdeee2-9264-4541-a631-c85341e1944a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260]
Oct 20 15:03:55 user nova-compute[76870]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511, portal: 172.16.0.220,3260] successful.
Oct 20 15:03:55 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc8dbc-6f74-4730-808b-7b6f827d31ab]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== disconnect_volume: return (267ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:03:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:56 user nova-compute[76870]: INFO nova.compute.manager [None req-f3e2970f-d60b-4eba-8829-a6e2b5caa101 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Get console output
Oct 20 15:03:56 user nova-compute[76870]: DEBUG nova.objects.instance [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'flavor' on Instance uuid ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-71341d67-bc6d-4b1a-b5a7-9b1c43b49619 tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.524s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:56 user nova-compute[76870]: INFO nova.compute.manager [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Terminating instance
Oct 20 15:03:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:56 user nova-compute[76870]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 15:03:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-b5a6731f-313f-4f1a-b100-c259374f0ba8 req-92212f25-d27d-47ac-b537-3b8c23a5aeee service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-vif-unplugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b5a6731f-313f-4f1a-b100-c259374f0ba8 req-92212f25-d27d-47ac-b537-3b8c23a5aeee service nova] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b5a6731f-313f-4f1a-b100-c259374f0ba8 req-92212f25-d27d-47ac-b537-3b8c23a5aeee service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b5a6731f-313f-4f1a-b100-c259374f0ba8 req-92212f25-d27d-47ac-b537-3b8c23a5aeee service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-b5a6731f-313f-4f1a-b100-c259374f0ba8 req-92212f25-d27d-47ac-b537-3b8c23a5aeee service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] No waiting events found dispatching network-vif-unplugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:03:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-b5a6731f-313f-4f1a-b100-c259374f0ba8 req-92212f25-d27d-47ac-b537-3b8c23a5aeee service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-vif-unplugged-425cd9d9-f423-4069-b010-00db8691b7bf for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:03:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Instance destroyed successfully.
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lazy-loading 'resources' on Instance uuid ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1391235145',display_name='tempest-VolumesSnapshotTestJSON-instance-1391235145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1391235145',id=39,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA//fh5jGwvGw4iJd05wzSrCL5he4ELRnDIUQiFh/LQZ/kNU9+kZ7+MWK6ZO0rhxWV7n3cPohA/cYz/5pbXBesZ5MARRV/k7ZPyW12j0FmUdwwbE1/3OqHb17fiOD9TS4Q==',key_name='tempest-keypair-858246862',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f630fc424cf49c7a2cd3881538e51c2',ramdisk_id='',reservation_id='r-vrglmwy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-380444352',owner_user_name='tempest-VolumesSnapshotTestJSON-380444352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92a6a66a0ef4d5bb5a3c35db785fed7',uuid=ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converting VIF {"id": "425cd9d9-f423-4069-b010-00db8691b7bf", "address": "fa:16:3e:1f:58:4e", "network": {"id": "2d3761b7-8e0e-46fb-afad-bfeb885ba078", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1505354590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f630fc424cf49c7a2cd3881538e51c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap425cd9d9-f4", "ovs_interfaceid": "425cd9d9-f423-4069-b010-00db8691b7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_vif [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap425cd9d9-f4, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c312cc8-a242-43c8-b2b9-c4da12a7b2a0) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:03:57 user nova-compute[76870]: INFO os_vif [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=425cd9d9-f423-4069-b010-00db8691b7bf,network=Network(2d3761b7-8e0e-46fb-afad-bfeb885ba078),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425cd9d9-f4')
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDfCtbNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:03:57 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ebaf8-89f7-4900-9a36-901639e13609]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:03:57 user nova-compute[76870]: No targets found.
Oct 20 15:03:57 user nova-compute[76870]: iSNS:
Oct 20 15:03:57 user nova-compute[76870]: No targets found.
Oct 20 15:03:57 user nova-compute[76870]: STATIC:
Oct 20 15:03:57 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:03:57 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:03:57 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:03:57 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:03:57 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:03:57 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:03:57 user nova-compute[76870]: FIRMWARE:
Oct 20 15:03:57 user nova-compute[76870]: No targets found.
Oct 20 15:03:57 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:03:57 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:03:57 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069c4198-0fe6-4f30-8cc7-62a295b7f511', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22322d1-a773-433e-bd1c-5d5dbb8032a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61cd6a2-3bd9-4525-934c-504e331fa10b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:57 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:03:57 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:03:57 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:03:57 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c1f1900>, {}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Disconnecting from: [] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] <== disconnect_volume: return (67ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:03:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Deleting instance files /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745_del
Oct 20 15:03:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Deletion of /opt/stack/data/nova/instances/ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745_del complete
Oct 20 15:03:57 user nova-compute[76870]: INFO nova.compute.manager [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:57 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-4574a8bb-081c-4b68-b64c-5a37605220e2 req-7b354161-784b-4069-8700-0c2624b3f080 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-vif-deleted-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:58 user nova-compute[76870]: INFO nova.compute.manager [req-4574a8bb-081c-4b68-b64c-5a37605220e2 req-7b354161-784b-4069-8700-0c2624b3f080 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Neutron deleted interface 425cd9d9-f423-4069-b010-00db8691b7bf; detaching it from the instance and deleting it from the info cache
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-4574a8bb-081c-4b68-b64c-5a37605220e2 req-7b354161-784b-4069-8700-0c2624b3f080 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:03:58 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Took 0.72 seconds to deallocate network for instance.
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-4574a8bb-081c-4b68-b64c-5a37605220e2 req-7b354161-784b-4069-8700-0c2624b3f080 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Detach interface failed, port_id=425cd9d9-f423-4069-b010-00db8691b7bf, reason: Instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745 could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 15:03:58 user nova-compute[76870]: WARNING nova.volume.cinder [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Attachment 1ef3bbd8-8298-4274-a443-6512785ae4a9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1ef3bbd8-8298-4274-a443-6512785ae4a9. (HTTP 404) (Request-ID: req-d40d0186-b913-435c-b7b0-e9489b5ecdf9)
Oct 20 15:03:58 user nova-compute[76870]: INFO nova.compute.manager [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:03:58 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8468MB free_disk=25.15904998779297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.166s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:58 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Deleted allocations for instance ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-221b7941-556e-4ca1-aca3-c1ebf3ce05ba req-0bbe8b9c-5ca9-42ce-bcd6-9198c7a24f82 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received event network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-221b7941-556e-4ca1-aca3-c1ebf3ce05ba req-0bbe8b9c-5ca9-42ce-bcd6-9198c7a24f82 service nova] Acquiring lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-221b7941-556e-4ca1-aca3-c1ebf3ce05ba req-0bbe8b9c-5ca9-42ce-bcd6-9198c7a24f82 service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-221b7941-556e-4ca1-aca3-c1ebf3ce05ba req-0bbe8b9c-5ca9-42ce-bcd6-9198c7a24f82 service nova] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-221b7941-556e-4ca1-aca3-c1ebf3ce05ba req-0bbe8b9c-5ca9-42ce-bcd6-9198c7a24f82 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] No waiting events found dispatching network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:03:58 user nova-compute[76870]: WARNING nova.compute.manager [req-221b7941-556e-4ca1-aca3-c1ebf3ce05ba req-0bbe8b9c-5ca9-42ce-bcd6-9198c7a24f82 service nova] [instance: ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745] Received unexpected event network-vif-plugged-425cd9d9-f423-4069-b010-00db8691b7bf for instance with vm_state deleted and task_state None.
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 3b919e78-e130-4299-8b92-e33dc028c6ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ddf2effd-bc16-4b2d-93b5-30674ce1085d tempest-VolumesSnapshotTestJSON-380444352 tempest-VolumesSnapshotTestJSON-380444352-project-member] Lock "ba3ec6d8-d1fd-4d8e-bd7a-29a1a945e745" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:03:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:03:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:03:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [{"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c575033f-89b0-4e8e-a827-50c8ab260713" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:04:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:04:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:04:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:04:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:51 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:51 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:04:57 user nova-compute[76870]: INFO nova.compute.manager [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Terminating instance
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Instance destroyed successfully.
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.objects.instance [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'resources' on Instance uuid c575033f-89b0-4e8e-a827-50c8ab260713 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-932890794',display_name='tempest-ServerActionsTestOtherA-server-932890794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-932890794',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-yatnb2fk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c575033f-89b0-4e8e-a827-50c8ab260713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "1752f9e4-bac7-4948-934b-27899ad99c04", "address": "fa:16:3e:91:96:17", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1752f9e4-ba", "ovs_interfaceid": "1752f9e4-bac7-4948-934b-27899ad99c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG os_vif [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-45201f53-8d83-4f55-a344-e6c7a383a10c req-c105c4e0-6b00-4972-8019-c82b8b0a2454 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-unplugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-45201f53-8d83-4f55-a344-e6c7a383a10c req-c105c4e0-6b00-4972-8019-c82b8b0a2454 service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-45201f53-8d83-4f55-a344-e6c7a383a10c req-c105c4e0-6b00-4972-8019-c82b8b0a2454 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-45201f53-8d83-4f55-a344-e6c7a383a10c req-c105c4e0-6b00-4972-8019-c82b8b0a2454 service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-45201f53-8d83-4f55-a344-e6c7a383a10c req-c105c4e0-6b00-4972-8019-c82b8b0a2454 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-unplugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-45201f53-8d83-4f55-a344-e6c7a383a10c req-c105c4e0-6b00-4972-8019-c82b8b0a2454 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-unplugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:04:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1752f9e4-ba, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de94414c-1ebe-4009-993f-24cbe53a6877) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:04:58 user nova-compute[76870]: INFO os_vif [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:96:17,bridge_name='br-int',has_traffic_filtering=True,id=1752f9e4-bac7-4948-934b-27899ad99c04,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1752f9e4-ba')
Oct 20 15:04:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQhbuNBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:04:58 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb66d85-2372-4613-bf4d-bd00698ce5a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:04:58 user nova-compute[76870]: No targets found.
Oct 20 15:04:58 user nova-compute[76870]: iSNS:
Oct 20 15:04:58 user nova-compute[76870]: No targets found.
Oct 20 15:04:58 user nova-compute[76870]: STATIC:
Oct 20 15:04:58 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c
Oct 20 15:04:58 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:04:58 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:04:58 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:04:58 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:04:58 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:04:58 user nova-compute[76870]: FIRMWARE:
Oct 20 15:04:58 user nova-compute[76870]: No targets found.
Oct 20 15:04:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:04:58 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:04:58 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01cc53-c5d2-4e4c-bdea-7091675a8c0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693eace-102f-4092-a0c1-4492b14306f8]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:04:58 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:04:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c (non-flash)
Oct 20 15:04:58 user nova-compute[76870]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:04:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf82616c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c'): ({'sde'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Removing single pathed devices sde {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a0a94a-99dd-4d64-96ea-ce8e3bb93805]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[66592872-ae72-40af-a399-edf3f378e709]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Flushing IO for device /dev/sde {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a2d0a-8c87-4003-b178-c322d1855ccd]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc97636b-8371-4138-84b0-63fe34a8b8b2]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] SCSI volumes sde have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23034303665383563', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1d72a80', '/dev/disk/by-id/scsi-1SCST_BIOe1d72a80-0406e85c00d99fde') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80b930b-ec44-4783-bd0b-5dccc183b8e6]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9482501f-9ff8-47d6-9674-8e7c8cc5e179]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[278edc26-15b8-4da4-8ea9-74ef823a4cbe]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260]
Oct 20 15:04:58 user nova-compute[76870]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c, portal: 172.16.0.220,3260] successful.
Oct 20 15:04:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdb25-c021-4456-8852-5d580d153a1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b9e65-e92a-4fc7-a932-9e8005eebdf7]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] <== disconnect_volume: return (355ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:04:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Deleting instance files /opt/stack/data/nova/instances/c575033f-89b0-4e8e-a827-50c8ab260713_del
Oct 20 15:04:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Deletion of /opt/stack/data/nova/instances/c575033f-89b0-4e8e-a827-50c8ab260713_del complete
Oct 20 15:04:58 user nova-compute[76870]: INFO nova.compute.manager [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:04:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:04:59 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Took 1.04 seconds to deallocate network for instance.
Oct 20 15:04:59 user nova-compute[76870]: DEBUG nova.compute.manager [req-00454d0a-7d8e-4e91-8b7e-1ab578dc9488 req-08b04e2a-8bbe-4df3-802e-f50b3a030123 service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-deleted-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:04:59 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-80f08bff-8d84-413d-af8b-9f84ecf0b681 req-3167b53f-ae01-4112-bd5c-837e42434d0e service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-80f08bff-8d84-413d-af8b-9f84ecf0b681 req-3167b53f-ae01-4112-bd5c-837e42434d0e service nova] Acquiring lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-80f08bff-8d84-413d-af8b-9f84ecf0b681 req-3167b53f-ae01-4112-bd5c-837e42434d0e service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-80f08bff-8d84-413d-af8b-9f84ecf0b681 req-3167b53f-ae01-4112-bd5c-837e42434d0e service nova] Lock "c575033f-89b0-4e8e-a827-50c8ab260713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-80f08bff-8d84-413d-af8b-9f84ecf0b681 req-3167b53f-ae01-4112-bd5c-837e42434d0e service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] No waiting events found dispatching network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:05:00 user nova-compute[76870]: WARNING nova.compute.manager [req-80f08bff-8d84-413d-af8b-9f84ecf0b681 req-3167b53f-ae01-4112-bd5c-837e42434d0e service nova] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Received unexpected event network-vif-plugged-1752f9e4-bac7-4948-934b-27899ad99c04 for instance with vm_state active and task_state deleting.
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:05:00 user nova-compute[76870]: INFO nova.compute.manager [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Took 1.17 seconds to detach 1 volumes for instance.
Oct 20 15:05:00 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:05:00 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.156387329101562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c575033f-89b0-4e8e-a827-50c8ab260713] Deleting volume: a56bdb25-c021-4456-8852-5d580d153a1c {{(pid=76870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c478f46b-f60b-4000-bc45-92430bd9b3af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c575033f-89b0-4e8e-a827-50c8ab260713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 3b919e78-e130-4299-8b92-e33dc028c6ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.166s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:01 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Deleted allocations for instance c575033f-89b0-4e8e-a827-50c8ab260713
Oct 20 15:05:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-a0a98e0c-3a0b-4f97-b8d4-4bb2d65b19e8 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c575033f-89b0-4e8e-a827-50c8ab260713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.114s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-changed-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG nova.compute.manager [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Refreshing instance network info cache due to event network-changed-074b89ea-7260-46e2-999e-dcafdd257b88. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] Acquiring lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] Acquired lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG nova.network.neutron [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Refreshing network info cache for port 074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:05:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:05:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updated VIF entry in instance network info cache for port 074b89ea-7260-46e2-999e-dcafdd257b88. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:05:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updating instance_info_cache with network_info: [{"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:05:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b6d20479-642c-4249-8bd8-7d59436c8bdf req-c31c3953-65db-4d3f-9103-f8c5481c118c service nova] Releasing lock "refresh_cache-3b919e78-e130-4299-8b92-e33dc028c6ef" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:03 user nova-compute[76870]: INFO nova.compute.manager [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Terminating instance
Oct 20 15:05:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-71c676b0-193f-4a21-b2aa-18a2d58e74f8 req-43d128ad-a654-48bd-bb77-d26aa8e57c2b service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-vif-unplugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71c676b0-193f-4a21-b2aa-18a2d58e74f8 req-43d128ad-a654-48bd-bb77-d26aa8e57c2b service nova] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71c676b0-193f-4a21-b2aa-18a2d58e74f8 req-43d128ad-a654-48bd-bb77-d26aa8e57c2b service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71c676b0-193f-4a21-b2aa-18a2d58e74f8 req-43d128ad-a654-48bd-bb77-d26aa8e57c2b service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-71c676b0-193f-4a21-b2aa-18a2d58e74f8 req-43d128ad-a654-48bd-bb77-d26aa8e57c2b service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] No waiting events found dispatching network-vif-unplugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:05:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-71c676b0-193f-4a21-b2aa-18a2d58e74f8 req-43d128ad-a654-48bd-bb77-d26aa8e57c2b service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-vif-unplugged-074b89ea-7260-46e2-999e-dcafdd257b88 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Instance destroyed successfully.
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'resources' on Instance uuid 3b919e78-e130-4299-8b92-e33dc028c6ef {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1165266410',display_name='tempest-TestVolumeBootPattern-server-1165266410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1165266410',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-1b3f7svg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:03:32Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=3b919e78-e130-4299-8b92-e33dc028c6ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "074b89ea-7260-46e2-999e-dcafdd257b88", "address": "fa:16:3e:46:ef:dd", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap074b89ea-72", "ovs_interfaceid": "074b89ea-7260-46e2-999e-dcafdd257b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_vif [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap074b89ea-72, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9abff2e-5b03-425d-9063-96c2e855c679) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: INFO os_vif [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ef:dd,bridge_name='br-int',has_traffic_filtering=True,id=074b89ea-7260-46e2-999e-dcafdd257b88,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap074b89ea-72')
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:05:04 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429a83b-757c-43a4-b932-5e92e37a02bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:05:04 user nova-compute[76870]: No targets found.
Oct 20 15:05:04 user nova-compute[76870]: iSNS:
Oct 20 15:05:04 user nova-compute[76870]: No targets found.
Oct 20 15:05:04 user nova-compute[76870]: STATIC:
Oct 20 15:05:04 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:05:04 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:05:04 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:05:04 user nova-compute[76870]: FIRMWARE:
Oct 20 15:05:04 user nova-compute[76870]: No targets found.
Oct 20 15:05:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:05:04 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:05:04 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4722b855-9b0f-4fb3-9761-c7184ec3ffb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c955941-aefc-4166-a565-1b5b66cbd68d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:05:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:05:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec2c21ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[24017d89-ac9f-4f98-bd36-1132d2e18e7f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[158bfae5-80db-43bc-95fd-0cceb381205d]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ceb93f-3b6f-4c8f-9f72-98ce5ce733e7]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b1edd-861a-4754-af46-2c49c9f4f8e5]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5029ec43-94f9a829ae47df67', '/dev/disk/by-id/scsi-23934663961383239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5029ec43') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b2098-cc20-4492-9b41-f9a312af68dd]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b664f23-9eed-4adf-a7db-f474e7638eb5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8617b5ec-1f82-44eb-b69f-7af6f93c6d92]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]
Oct 20 15:05:04 user nova-compute[76870]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.
Oct 20 15:05:04 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec4f41-6e3f-4220-be04-52fbb0cf1c30]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== disconnect_volume: return (345ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:05:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Deleting instance files /opt/stack/data/nova/instances/3b919e78-e130-4299-8b92-e33dc028c6ef_del
Oct 20 15:05:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Deletion of /opt/stack/data/nova/instances/3b919e78-e130-4299-8b92-e33dc028c6ef_del complete
Oct 20 15:05:04 user nova-compute[76870]: INFO nova.compute.manager [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 20 15:05:04 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:05:05 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Took 0.98 seconds to deallocate network for instance.
Oct 20 15:05:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-cb751c74-1614-4fbc-bf27-d9138f525eaa req-cf7de924-332c-4154-84e7-eb5da6906286 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-vif-deleted-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a228f870-b0bb-4d5f-9c06-cbd625350f72 req-450852c9-f58d-4f94-8b3b-98c7da4c1139 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received event network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a228f870-b0bb-4d5f-9c06-cbd625350f72 req-450852c9-f58d-4f94-8b3b-98c7da4c1139 service nova] Acquiring lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a228f870-b0bb-4d5f-9c06-cbd625350f72 req-450852c9-f58d-4f94-8b3b-98c7da4c1139 service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a228f870-b0bb-4d5f-9c06-cbd625350f72 req-450852c9-f58d-4f94-8b3b-98c7da4c1139 service nova] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-a228f870-b0bb-4d5f-9c06-cbd625350f72 req-450852c9-f58d-4f94-8b3b-98c7da4c1139 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] No waiting events found dispatching network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:05:05 user nova-compute[76870]: WARNING nova.compute.manager [req-a228f870-b0bb-4d5f-9c06-cbd625350f72 req-450852c9-f58d-4f94-8b3b-98c7da4c1139 service nova] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Received unexpected event network-vif-plugged-074b89ea-7260-46e2-999e-dcafdd257b88 for instance with vm_state active and task_state deleting.
Oct 20 15:05:06 user nova-compute[76870]: INFO nova.compute.manager [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: 3b919e78-e130-4299-8b92-e33dc028c6ef] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 15:05:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:06 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:05:06 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:05:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:06 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Deleted allocations for instance 3b919e78-e130-4299-8b92-e33dc028c6ef
Oct 20 15:05:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-79392b7a-4cec-4c19-8d44-2f362a9b9f19 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "3b919e78-e130-4299-8b92-e33dc028c6ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.400s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:05:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "eb6106d9-370f-4384-b45c-92965eea5b98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:05:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:55 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:05:55 user nova-compute[76870]: INFO nova.compute.claims [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Claim successful on node user
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.network.neutron [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:05:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.policy [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '407faf0fe9f44219a2d0580e9819f8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710a95fd9def4ae08263d4cdafbdffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:05:56 user nova-compute[76870]: INFO nova.virt.block_device [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Booting with volume 5a37a1df-33b8-4532-bd03-1c0698ed8c32 at /dev/vda
Oct 20 15:05:56 user nova-compute[76870]: DEBUG os_brick.utils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab947e7-0ef3-4721-ae0a-31c16e54fe33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc5b5d7-0b74-423b-aad6-6cfe5f456aa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c05a4-ca75-43ca-9cea-8c030307ddbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde47760-83d2-4876-a189-44721113a706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:05:56 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec54ba-6ed1-4e01-8ecc-a124219191ea]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG os_brick.utils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating existing volume attachment record: fd0f8dc5-9f31-4785-bfce-5b3832ef8539 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:05:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Successfully created port: 2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Successfully updated port: 2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquired lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-changed-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Refreshing instance network info cache due to event network-changed-2f178107-7d24-4784-9d8b-b3627563e74f. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] Acquiring lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Releasing lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Instance network_info: |[{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] Acquired lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Refreshing network info cache for port 2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:05:58 user nova-compute[76870]: INFO nova.compute.manager [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Terminating instance
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updated VIF entry in instance network info cache for port 2f178107-7d24-4784-9d8b-b3627563e74f. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c0d1e1ff-722a-4632-b309-fed0cf71ba43 req-73a2633d-f8c0-4123-a2f9-e37eab616bf1 service nova] Releasing lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Instance destroyed successfully.
Oct 20 15:05:59 user nova-compute[76870]: DEBUG nova.objects.instance [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lazy-loading 'resources' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T14:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2130770255',display_name='tempest-ServerActionsTestOtherA-server-2130770255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2130770255',id=3,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPdl21veiqVEsp9tZJ9a7twyCTZEJpB8uSDYmMY1/lQKHUwjD1g15JVDG41NZJOxosVygZb2jS2EUv7ZAdwRLD+/uj24vYGdh3Xz1XR33UNm8E/JpzOPTLqkmlme2WAA==',key_name='tempest-keypair-2076942768',keypairs=<?>,launch_index=0,launched_at=2023-10-20T14:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94c8ea9d998b4ba587b16fec8b792c13',ramdisk_id='',reservation_id='r-z9s7geqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-404958601',owner_user_name='tempest-ServerActionsTestOtherA-404958601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T14:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91e65eb07d084dcb9e5e9188961f4b44',uuid=c478f46b-f60b-4000-bc45-92430bd9b3af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converting VIF {"id": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "address": "fa:16:3e:94:a7:98", "network": {"id": "7868a956-d356-428e-a8ab-11d50a63add3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1447087270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94c8ea9d998b4ba587b16fec8b792c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa79a316-74", "ovs_interfaceid": "fa79a316-749b-41e5-811d-c28cdd5ae51e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG os_vif [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa79a316-74, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccbb5e52-ab7a-4b73-85e8-0de44e87fd51) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:05:59 user nova-compute[76870]: INFO os_vif [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:a7:98,bridge_name='br-int',has_traffic_filtering=True,id=fa79a316-749b-41e5-811d-c28cdd5ae51e,network=Network(7868a956-d356-428e-a8ab-11d50a63add3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa79a316-74')
Oct 20 15:05:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Deleting instance files /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af_del
Oct 20 15:05:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Deletion of /opt/stack/data/nova/instances/c478f46b-f60b-4000-bc45-92430bd9b3af_del complete
Oct 20 15:05:59 user nova-compute[76870]: INFO nova.compute.manager [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 15:05:59 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:05:59 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-vif-unplugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] No waiting events found dispatching network-vif-unplugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-vif-unplugged-fa79a316-749b-41e5-811d-c28cdd5ae51e for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] Acquiring lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] No waiting events found dispatching network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:06:00 user nova-compute[76870]: WARNING nova.compute.manager [req-e914e449-6ff0-4559-9bc5-7128682733b3 req-2457158c-0a7c-4e79-9c20-12abb049e32d service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received unexpected event network-vif-plugged-fa79a316-749b-41e5-811d-c28cdd5ae51e for instance with vm_state active and task_state deleting.
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:06:00 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Took 0.83 seconds to deallocate network for instance.
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Skipping network cache update for instance because it is Building. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid c478f46b-f60b-4000-bc45-92430bd9b3af {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:06:00 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Deleted allocations for instance c478f46b-f60b-4000-bc45-92430bd9b3af
Oct 20 15:06:00 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:06:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0459fe41-c20f-4c8a-b078-24907e351571 tempest-ServerActionsTestOtherA-404958601 tempest-ServerActionsTestOtherA-404958601-project-member] Lock "c478f46b-f60b-4000-bc45-92430bd9b3af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c478f46b-f60b-4000-bc45-92430bd9b3af" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:06:01 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:06:01 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:06:01 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.173282623291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance eb6106d9-370f-4384-b45c-92965eea5b98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-4817438b-7061-4267-91c8-d9c3d04bb3d9 req-882cc522-5fde-4eb9-b37b-5aa0008f3b85 service nova] [instance: c478f46b-f60b-4000-bc45-92430bd9b3af] Received event network-vif-deleted-fa79a316-749b-41e5-811d-c28cdd5ae51e {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:06:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:06:13 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Creating image(s)
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6106d9-370f-4384-b45c-92965eea5b98/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Start _get_guest_xml network_info=[{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fd0f8dc5-9f31-4785-bfce-5b3832ef8539', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb6106d9-370f-4384-b45c-92965eea5b98', 'attached_at': '', 'detached_at': '', 'volume_id': '5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'serial': '5a37a1df-33b8-4532-bd03-1c0698ed8c32'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:06:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:06:13 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:06:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:06:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:06:13 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec4ea0f-2ff8-4055-a4d7-747aa6821c06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:06:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[44008cbc-bcc6-43b9-ae28-a443e442593e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32] added
Oct 20 15:06:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f937481d-19e3-45a7-a6b8-6e157dca033f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f5b85d-526c-49a4-81c2-638d091556df]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZOrJEUHy {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZOrJEUHy" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51629d5-fb13-4d24-8f42-cb40e248fc25]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZOrJEUHy'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9b783-c3f8-470d-85ad-c5f6a61cb088]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d548c99-be55-4c0e-8368-4a1bff885244]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 15:06:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 15:06:13 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:06:13 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 15:06:13 user nova-compute[76870]: 
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af578543-d53e-4790-b564-3c26e7c84578]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]
Oct 20 15:06:13 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.
Oct 20 15:06:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd26bd-22f7-456e-b489-8a7a9707f3ec]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad621cf-11ad-4f85-aee9-327ec0730a7b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:06:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:06:13 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1be3d2-7bde-4e11-b2db-ed9efc05a097]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:06:13 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23934663961383239', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663961383239', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1738241168',display_name='tempest-TestVolumeBootPattern-server-1738241168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1738241168',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-fkeg740r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:05:56Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=eb6106d9-370f-4384-b45c-92965eea5b98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6106d9-370f-4384-b45c-92965eea5b98 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:06:14 user nova-compute[76870]:   <uuid>eb6106d9-370f-4384-b45c-92965eea5b98</uuid>
Oct 20 15:06:14 user nova-compute[76870]:   <name>instance-00000029</name>
Oct 20 15:06:14 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:06:14 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:06:14 user nova-compute[76870]:   <metadata>
Oct 20 15:06:14 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:06:14 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:06:14 user nova-compute[76870]:       <nova:name>tempest-TestVolumeBootPattern-server-1738241168</nova:name>
Oct 20 15:06:14 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:06:13</nova:creationTime>
Oct 20 15:06:14 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:06:14 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:06:14 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:06:14 user nova-compute[76870]:       <nova:owner>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:user uuid="407faf0fe9f44219a2d0580e9819f8ec">tempest-TestVolumeBootPattern-2023237776-project-member</nova:user>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:project uuid="710a95fd9def4ae08263d4cdafbdffd3">tempest-TestVolumeBootPattern-2023237776</nova:project>
Oct 20 15:06:14 user nova-compute[76870]:       </nova:owner>
Oct 20 15:06:14 user nova-compute[76870]:       <nova:ports>
Oct 20 15:06:14 user nova-compute[76870]:         <nova:port uuid="2f178107-7d24-4784-9d8b-b3627563e74f">
Oct 20 15:06:14 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 15:06:14 user nova-compute[76870]:         </nova:port>
Oct 20 15:06:14 user nova-compute[76870]:       </nova:ports>
Oct 20 15:06:14 user nova-compute[76870]:     </nova:instance>
Oct 20 15:06:14 user nova-compute[76870]:   </metadata>
Oct 20 15:06:14 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:06:14 user nova-compute[76870]:     <system>
Oct 20 15:06:14 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:06:14 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:06:14 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:06:14 user nova-compute[76870]:       <entry name="serial">eb6106d9-370f-4384-b45c-92965eea5b98</entry>
Oct 20 15:06:14 user nova-compute[76870]:       <entry name="uuid">eb6106d9-370f-4384-b45c-92965eea5b98</entry>
Oct 20 15:06:14 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:06:14 user nova-compute[76870]:     </system>
Oct 20 15:06:14 user nova-compute[76870]:   </sysinfo>
Oct 20 15:06:14 user nova-compute[76870]:   <os>
Oct 20 15:06:14 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:06:14 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:06:14 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:06:14 user nova-compute[76870]:   </os>
Oct 20 15:06:14 user nova-compute[76870]:   <features>
Oct 20 15:06:14 user nova-compute[76870]:     <acpi/>
Oct 20 15:06:14 user nova-compute[76870]:     <apic/>
Oct 20 15:06:14 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:06:14 user nova-compute[76870]:   </features>
Oct 20 15:06:14 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:06:14 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:06:14 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:06:14 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:06:14 user nova-compute[76870]:   </clock>
Oct 20 15:06:14 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:06:14 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:06:14 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:06:14 user nova-compute[76870]:   </cpu>
Oct 20 15:06:14 user nova-compute[76870]:   <devices>
Oct 20 15:06:14 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:06:14 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:06:14 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 15:06:14 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:06:14 user nova-compute[76870]:       <serial>5a37a1df-33b8-4532-bd03-1c0698ed8c32</serial>
Oct 20 15:06:14 user nova-compute[76870]:     </disk>
Oct 20 15:06:14 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:06:14 user nova-compute[76870]:       <mac address="fa:16:3e:2e:d9:a3"/>
Oct 20 15:06:14 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:06:14 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:06:14 user nova-compute[76870]:       <target dev="tap2f178107-7d"/>
Oct 20 15:06:14 user nova-compute[76870]:     </interface>
Oct 20 15:06:14 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:06:14 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/eb6106d9-370f-4384-b45c-92965eea5b98/console.log" append="off"/>
Oct 20 15:06:14 user nova-compute[76870]:     </serial>
Oct 20 15:06:14 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:06:14 user nova-compute[76870]:     <video>
Oct 20 15:06:14 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:06:14 user nova-compute[76870]:     </video>
Oct 20 15:06:14 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:06:14 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:06:14 user nova-compute[76870]:     </rng>
Oct 20 15:06:14 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:06:14 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:06:14 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:06:14 user nova-compute[76870]:     </memballoon>
Oct 20 15:06:14 user nova-compute[76870]:   </devices>
Oct 20 15:06:14 user nova-compute[76870]: </domain>
Oct 20 15:06:14 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1738241168',display_name='tempest-TestVolumeBootPattern-server-1738241168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1738241168',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-fkeg740r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:05:56Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=eb6106d9-370f-4384-b45c-92965eea5b98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG os_vif [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c16c477e-b0d6-50b5-8c20-8c534b4c30c5', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f178107-7d, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f178107-7d, col_values=(('qos', UUID('37863ecd-f9ab-49bd-ae59-3b6c361f242a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f178107-7d, col_values=(('external_ids', {'iface-id': '2f178107-7d24-4784-9d8b-b3627563e74f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:d9:a3', 'vm-uuid': 'eb6106d9-370f-4384-b45c-92965eea5b98'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:06:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:15 user nova-compute[76870]: INFO os_vif [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d')
Oct 20 15:06:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:06:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No VIF found with MAC fa:16:3e:2e:d9:a3, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5e4fed2b-6a25-48f3-b15c-fa13987b381b req-b02b2fc6-717a-4a4b-9edf-4646aa599282 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e4fed2b-6a25-48f3-b15c-fa13987b381b req-b02b2fc6-717a-4a4b-9edf-4646aa599282 service nova] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e4fed2b-6a25-48f3-b15c-fa13987b381b req-b02b2fc6-717a-4a4b-9edf-4646aa599282 service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5e4fed2b-6a25-48f3-b15c-fa13987b381b req-b02b2fc6-717a-4a4b-9edf-4646aa599282 service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-5e4fed2b-6a25-48f3-b15c-fa13987b381b req-b02b2fc6-717a-4a4b-9edf-4646aa599282 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] No waiting events found dispatching network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:06:16 user nova-compute[76870]: WARNING nova.compute.manager [req-5e4fed2b-6a25-48f3-b15c-fa13987b381b req-b02b2fc6-717a-4a4b-9edf-4646aa599282 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received unexpected event network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f for instance with vm_state building and task_state spawning.
Oct 20 15:06:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Instance spawned successfully.
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Took 5.02 seconds to spawn the instance on the hypervisor.
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-932f5cf4-45c2-461d-b111-9150bdf02215 req-c442a9ab-f365-4064-a401-776d3d33188e service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-932f5cf4-45c2-461d-b111-9150bdf02215 req-c442a9ab-f365-4064-a401-776d3d33188e service nova] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-932f5cf4-45c2-461d-b111-9150bdf02215 req-c442a9ab-f365-4064-a401-776d3d33188e service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-932f5cf4-45c2-461d-b111-9150bdf02215 req-c442a9ab-f365-4064-a401-776d3d33188e service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.compute.manager [req-932f5cf4-45c2-461d-b111-9150bdf02215 req-c442a9ab-f365-4064-a401-776d3d33188e service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] No waiting events found dispatching network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.compute.manager [req-932f5cf4-45c2-461d-b111-9150bdf02215 req-c442a9ab-f365-4064-a401-776d3d33188e service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received unexpected event network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f for instance with vm_state building and task_state spawning.
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.compute.manager [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Took 22.73 seconds to build instance.
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-09cd1063-6f46-4c49-848e-a7fd4103f808 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "eb6106d9-370f-4384-b45c-92965eea5b98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.854s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Verify base images {{(pid=76870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=76870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] eb6106d9-370f-4384-b45c-92965eea5b98 is a valid instance name {{(pid=76870) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6
Oct 20 15:06:18 user nova-compute[76870]: WARNING nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Removable base files: /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513 /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3 /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6 /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8306be75cf1693e098ab0cf679dacdc1d1c3513
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4a40e64a712b2fbd0339c6e5b74fa4a55560452a
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34cd2e279cc912ec498a8d0f29c2411448a252bf
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e1a5c8242a9b99c643904e71aa6473458f9e56e3
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ca613031cfb482bdb71001e03d67d4c11ea21d6
Oct 20 15:06:18 user nova-compute[76870]: INFO nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb9b623f9ce0fbb35b074f31933196eb725c8457
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Verification complete {{(pid=76870) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Verify swap images {{(pid=76870) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 15:06:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.imagecache [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Verify ephemeral images {{(pid=76870) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 15:06:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:06:35 user nova-compute[76870]: INFO nova.compute.claims [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Claim successful on node user
Oct 20 15:06:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:06:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.policy [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '121e9739ffb740a3bfc065653a688438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e4b60edd64426696234f2fdff0f4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:06:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Creating image(s)
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "/opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "/opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "/opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.191s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk 1073741824" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.166s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Successfully created port: ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Cannot resize image /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Ensure instance console log exists: /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Successfully updated port: ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-changed-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Refreshing instance network info cache due to event network-changed-ba4801b4-d24c-4e79-a59f-6c9d6f715160. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Instance network_info: |[{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Refreshing network info cache for port ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Start _get_guest_xml network_info=[{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:06:37 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:06:37 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1782535738',display_name='tempest-TestStampPattern-server-1782535738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1782535738',id=42,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6R61bltWmFa4FN/tWsYq0yxOivPOQKTAZeSQ5dsXkeubEsA2nCFaQStvXLxjmWo+g7lDxjht2O1Ocr4vblBDS8eTt8LrHcMZl0qklvkcI+40/AmthHciFjuWJkDB4Dw==',key_name='tempest-TestStampPattern-738172330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e4b60edd64426696234f2fdff0f4a1',ramdisk_id='',reservation_id='r-x4h13etf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1703985163',owner_user_name='tempest-TestStampPattern-1703985163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:06:35Z,user_data=None,user_id='121e9739ffb740a3bfc065653a688438',uuid=a15d285b-c295-4a79-abd5-d535155130f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converting VIF {"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'pci_devices' on Instance uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:06:37 user nova-compute[76870]:   <uuid>a15d285b-c295-4a79-abd5-d535155130f1</uuid>
Oct 20 15:06:37 user nova-compute[76870]:   <name>instance-0000002a</name>
Oct 20 15:06:37 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:06:37 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:06:37 user nova-compute[76870]:   <metadata>
Oct 20 15:06:37 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:06:37 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:06:37 user nova-compute[76870]:       <nova:name>tempest-TestStampPattern-server-1782535738</nova:name>
Oct 20 15:06:37 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:06:37</nova:creationTime>
Oct 20 15:06:37 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:06:37 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:06:37 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:06:37 user nova-compute[76870]:       <nova:owner>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:user uuid="121e9739ffb740a3bfc065653a688438">tempest-TestStampPattern-1703985163-project-member</nova:user>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:project uuid="d5e4b60edd64426696234f2fdff0f4a1">tempest-TestStampPattern-1703985163</nova:project>
Oct 20 15:06:37 user nova-compute[76870]:       </nova:owner>
Oct 20 15:06:37 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:06:37 user nova-compute[76870]:       <nova:ports>
Oct 20 15:06:37 user nova-compute[76870]:         <nova:port uuid="ba4801b4-d24c-4e79-a59f-6c9d6f715160">
Oct 20 15:06:37 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 15:06:37 user nova-compute[76870]:         </nova:port>
Oct 20 15:06:37 user nova-compute[76870]:       </nova:ports>
Oct 20 15:06:37 user nova-compute[76870]:     </nova:instance>
Oct 20 15:06:37 user nova-compute[76870]:   </metadata>
Oct 20 15:06:37 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:06:37 user nova-compute[76870]:     <system>
Oct 20 15:06:37 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:06:37 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:06:37 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:06:37 user nova-compute[76870]:       <entry name="serial">a15d285b-c295-4a79-abd5-d535155130f1</entry>
Oct 20 15:06:37 user nova-compute[76870]:       <entry name="uuid">a15d285b-c295-4a79-abd5-d535155130f1</entry>
Oct 20 15:06:37 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:06:37 user nova-compute[76870]:     </system>
Oct 20 15:06:37 user nova-compute[76870]:   </sysinfo>
Oct 20 15:06:37 user nova-compute[76870]:   <os>
Oct 20 15:06:37 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:06:37 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:06:37 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:06:37 user nova-compute[76870]:   </os>
Oct 20 15:06:37 user nova-compute[76870]:   <features>
Oct 20 15:06:37 user nova-compute[76870]:     <acpi/>
Oct 20 15:06:37 user nova-compute[76870]:     <apic/>
Oct 20 15:06:37 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:06:37 user nova-compute[76870]:   </features>
Oct 20 15:06:37 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:06:37 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:06:37 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:06:37 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:06:37 user nova-compute[76870]:   </clock>
Oct 20 15:06:37 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:06:37 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:06:37 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:06:37 user nova-compute[76870]:   </cpu>
Oct 20 15:06:37 user nova-compute[76870]:   <devices>
Oct 20 15:06:37 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:06:37 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:06:37 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk"/>
Oct 20 15:06:37 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:06:37 user nova-compute[76870]:     </disk>
Oct 20 15:06:37 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:06:37 user nova-compute[76870]:       <mac address="fa:16:3e:5a:9f:32"/>
Oct 20 15:06:37 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:06:37 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:06:37 user nova-compute[76870]:       <target dev="tapba4801b4-d2"/>
Oct 20 15:06:37 user nova-compute[76870]:     </interface>
Oct 20 15:06:37 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:06:37 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/console.log" append="off"/>
Oct 20 15:06:37 user nova-compute[76870]:     </serial>
Oct 20 15:06:37 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:06:37 user nova-compute[76870]:     <video>
Oct 20 15:06:37 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:06:37 user nova-compute[76870]:     </video>
Oct 20 15:06:37 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:06:37 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:06:37 user nova-compute[76870]:     </rng>
Oct 20 15:06:37 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:06:37 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:06:37 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:06:37 user nova-compute[76870]:     </memballoon>
Oct 20 15:06:37 user nova-compute[76870]:   </devices>
Oct 20 15:06:37 user nova-compute[76870]: </domain>
Oct 20 15:06:37 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1782535738',display_name='tempest-TestStampPattern-server-1782535738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1782535738',id=42,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6R61bltWmFa4FN/tWsYq0yxOivPOQKTAZeSQ5dsXkeubEsA2nCFaQStvXLxjmWo+g7lDxjht2O1Ocr4vblBDS8eTt8LrHcMZl0qklvkcI+40/AmthHciFjuWJkDB4Dw==',key_name='tempest-TestStampPattern-738172330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e4b60edd64426696234f2fdff0f4a1',ramdisk_id='',reservation_id='r-x4h13etf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1703985163',owner_user_name='tempest-TestStampPattern-1703985163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:06:35Z,user_data=None,user_id='121e9739ffb740a3bfc065653a688438',uuid=a15d285b-c295-4a79-abd5-d535155130f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converting VIF {"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG os_vif [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96c6bd77-c10b-595f-b7c6-4c4471f2044e', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4801b4-d2, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba4801b4-d2, col_values=(('qos', UUID('23776f15-fea0-4d71-bf37-6bb1c69c35ba')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba4801b4-d2, col_values=(('external_ids', {'iface-id': 'ba4801b4-d24c-4e79-a59f-6c9d6f715160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:9f:32', 'vm-uuid': 'a15d285b-c295-4a79-abd5-d535155130f1'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:37 user nova-compute[76870]: INFO os_vif [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2')
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No VIF found with MAC fa:16:3e:5a:9f:32, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updated VIF entry in instance network info cache for port ba4801b4-d24c-4e79-a59f-6c9d6f715160. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:06:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-87b12a02-1bbb-4c30-8392-2662f0fa0c17 req-08a6b3fa-abda-4861-849b-6e5be7eee649 service nova] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:06:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-4ac72043-b7a8-4194-9dce-e5205ab8dc77 req-aeb1fbea-1a87-4dc0-b54c-dbf37e5829b4 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4ac72043-b7a8-4194-9dce-e5205ab8dc77 req-aeb1fbea-1a87-4dc0-b54c-dbf37e5829b4 service nova] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4ac72043-b7a8-4194-9dce-e5205ab8dc77 req-aeb1fbea-1a87-4dc0-b54c-dbf37e5829b4 service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4ac72043-b7a8-4194-9dce-e5205ab8dc77 req-aeb1fbea-1a87-4dc0-b54c-dbf37e5829b4 service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-4ac72043-b7a8-4194-9dce-e5205ab8dc77 req-aeb1fbea-1a87-4dc0-b54c-dbf37e5829b4 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] No waiting events found dispatching network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:06:39 user nova-compute[76870]: WARNING nova.compute.manager [req-4ac72043-b7a8-4194-9dce-e5205ab8dc77 req-aeb1fbea-1a87-4dc0-b54c-dbf37e5829b4 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received unexpected event network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 for instance with vm_state building and task_state spawning.
Oct 20 15:06:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:06:41 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Instance spawned successfully.
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-4f014fc0-425b-42c2-8ec1-9d0a2c35b7c9 req-f1e51182-1cb6-424c-8d27-9f3a73bd4a3e service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4f014fc0-425b-42c2-8ec1-9d0a2c35b7c9 req-f1e51182-1cb6-424c-8d27-9f3a73bd4a3e service nova] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4f014fc0-425b-42c2-8ec1-9d0a2c35b7c9 req-f1e51182-1cb6-424c-8d27-9f3a73bd4a3e service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4f014fc0-425b-42c2-8ec1-9d0a2c35b7c9 req-f1e51182-1cb6-424c-8d27-9f3a73bd4a3e service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-4f014fc0-425b-42c2-8ec1-9d0a2c35b7c9 req-f1e51182-1cb6-424c-8d27-9f3a73bd4a3e service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] No waiting events found dispatching network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:06:41 user nova-compute[76870]: WARNING nova.compute.manager [req-4f014fc0-425b-42c2-8ec1-9d0a2c35b7c9 req-f1e51182-1cb6-424c-8d27-9f3a73bd4a3e service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received unexpected event network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 for instance with vm_state building and task_state spawning.
Oct 20 15:06:41 user nova-compute[76870]: INFO nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 20 15:06:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:06:41 user nova-compute[76870]: INFO nova.compute.manager [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Took 6.33 seconds to build instance.
Oct 20 15:06:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c6e5d73c-44f9-4593-a716-ad63bcdd489b tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.420s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:06:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:52 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:54 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:06:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:06:57 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:06:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:07:01 user nova-compute[76870]: INFO nova.compute.claims [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Claim successful on node user
Oct 20 15:07:01 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:07:01 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.14163589477539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:07:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.535s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:07:02 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance eb6106d9-370f-4384-b45c-92965eea5b98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:07:02 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Creating image(s)
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "/opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.policy [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3271422bfb4145dbad9e30dc8799aeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f01dd35514c0d98db23904e4ad1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.203s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk 1073741824" returned: 0 in 0.057s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:07:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Cannot resize image /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Ensure instance console log exists: /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Successfully created port: 1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Successfully updated port: 1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-changed-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Refreshing instance network info cache due to event network-changed-1a346767-34a2-4bf6-8ed0-7ab96f3af436. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:07:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Instance network_info: |[{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Refreshing network info cache for port 1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Start _get_guest_xml network_info=[{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:07:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:07:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-797271511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-797271511',id=43,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-j7hesshs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:07:02Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=d76f1201-1935-45a3-a6cb-878c77a7e57d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'pci_devices' on Instance uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:07:04 user nova-compute[76870]:   <uuid>d76f1201-1935-45a3-a6cb-878c77a7e57d</uuid>
Oct 20 15:07:04 user nova-compute[76870]:   <name>instance-0000002b</name>
Oct 20 15:07:04 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:07:04 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:07:04 user nova-compute[76870]:   <metadata>
Oct 20 15:07:04 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:07:04 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:07:04 user nova-compute[76870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-797271511</nova:name>
Oct 20 15:07:04 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:07:04</nova:creationTime>
Oct 20 15:07:04 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:07:04 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:07:04 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:07:04 user nova-compute[76870]:       <nova:owner>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:user uuid="3271422bfb4145dbad9e30dc8799aeb6">tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member</nova:user>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:project uuid="335f01dd35514c0d98db23904e4ad1d3">tempest-ServerBootFromVolumeStableRescueTest-1789045836</nova:project>
Oct 20 15:07:04 user nova-compute[76870]:       </nova:owner>
Oct 20 15:07:04 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:07:04 user nova-compute[76870]:       <nova:ports>
Oct 20 15:07:04 user nova-compute[76870]:         <nova:port uuid="1a346767-34a2-4bf6-8ed0-7ab96f3af436">
Oct 20 15:07:04 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 15:07:04 user nova-compute[76870]:         </nova:port>
Oct 20 15:07:04 user nova-compute[76870]:       </nova:ports>
Oct 20 15:07:04 user nova-compute[76870]:     </nova:instance>
Oct 20 15:07:04 user nova-compute[76870]:   </metadata>
Oct 20 15:07:04 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:07:04 user nova-compute[76870]:     <system>
Oct 20 15:07:04 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:07:04 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:07:04 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:07:04 user nova-compute[76870]:       <entry name="serial">d76f1201-1935-45a3-a6cb-878c77a7e57d</entry>
Oct 20 15:07:04 user nova-compute[76870]:       <entry name="uuid">d76f1201-1935-45a3-a6cb-878c77a7e57d</entry>
Oct 20 15:07:04 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:07:04 user nova-compute[76870]:     </system>
Oct 20 15:07:04 user nova-compute[76870]:   </sysinfo>
Oct 20 15:07:04 user nova-compute[76870]:   <os>
Oct 20 15:07:04 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:07:04 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:07:04 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:07:04 user nova-compute[76870]:   </os>
Oct 20 15:07:04 user nova-compute[76870]:   <features>
Oct 20 15:07:04 user nova-compute[76870]:     <acpi/>
Oct 20 15:07:04 user nova-compute[76870]:     <apic/>
Oct 20 15:07:04 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:07:04 user nova-compute[76870]:   </features>
Oct 20 15:07:04 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:07:04 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:07:04 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:07:04 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:07:04 user nova-compute[76870]:   </clock>
Oct 20 15:07:04 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:07:04 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:07:04 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:07:04 user nova-compute[76870]:   </cpu>
Oct 20 15:07:04 user nova-compute[76870]:   <devices>
Oct 20 15:07:04 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:07:04 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:07:04 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk"/>
Oct 20 15:07:04 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:07:04 user nova-compute[76870]:     </disk>
Oct 20 15:07:04 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:07:04 user nova-compute[76870]:       <mac address="fa:16:3e:ef:ef:07"/>
Oct 20 15:07:04 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:07:04 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:07:04 user nova-compute[76870]:       <target dev="tap1a346767-34"/>
Oct 20 15:07:04 user nova-compute[76870]:     </interface>
Oct 20 15:07:04 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:07:04 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/console.log" append="off"/>
Oct 20 15:07:04 user nova-compute[76870]:     </serial>
Oct 20 15:07:04 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:07:04 user nova-compute[76870]:     <video>
Oct 20 15:07:04 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:07:04 user nova-compute[76870]:     </video>
Oct 20 15:07:04 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:07:04 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:07:04 user nova-compute[76870]:     </rng>
Oct 20 15:07:04 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:07:04 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:07:04 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:07:04 user nova-compute[76870]:     </memballoon>
Oct 20 15:07:04 user nova-compute[76870]:   </devices>
Oct 20 15:07:04 user nova-compute[76870]: </domain>
Oct 20 15:07:04 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-797271511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-797271511',id=43,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-j7hesshs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:07:02Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=d76f1201-1935-45a3-a6cb-878c77a7e57d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG os_vif [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9978d2e2-de3f-5ba5-b0b5-e44531245fac', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a346767-34, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a346767-34, col_values=(('qos', UUID('2aeaec5d-c90e-4031-ace1-05354b1219e0')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a346767-34, col_values=(('external_ids', {'iface-id': '1a346767-34a2-4bf6-8ed0-7ab96f3af436', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:ef:07', 'vm-uuid': 'd76f1201-1935-45a3-a6cb-878c77a7e57d'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:04 user nova-compute[76870]: INFO os_vif [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34')
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No VIF found with MAC fa:16:3e:ef:ef:07, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Skipping network cache update for instance because it is Building. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid eb6106d9-370f-4384-b45c-92965eea5b98 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updated VIF entry in instance network info cache for port 1a346767-34a2-4bf6-8ed0-7ab96f3af436. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ddce6d4e-648c-47b6-a0ca-0103d2fa3786 req-11306580-0b95-4688-bcfa-1ac39e391de1 service nova] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:07:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:07:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-a42c1d23-8aac-4d83-b583-0b266193bea7 req-a007ebfb-8c4b-4e96-8199-b56fb6e1848c service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a42c1d23-8aac-4d83-b583-0b266193bea7 req-a007ebfb-8c4b-4e96-8199-b56fb6e1848c service nova] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a42c1d23-8aac-4d83-b583-0b266193bea7 req-a007ebfb-8c4b-4e96-8199-b56fb6e1848c service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a42c1d23-8aac-4d83-b583-0b266193bea7 req-a007ebfb-8c4b-4e96-8199-b56fb6e1848c service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-a42c1d23-8aac-4d83-b583-0b266193bea7 req-a007ebfb-8c4b-4e96-8199-b56fb6e1848c service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] No waiting events found dispatching network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:07:06 user nova-compute[76870]: WARNING nova.compute.manager [req-a42c1d23-8aac-4d83-b583-0b266193bea7 req-a007ebfb-8c4b-4e96-8199-b56fb6e1848c service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received unexpected event network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 for instance with vm_state building and task_state spawning.
Oct 20 15:07:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:07:07 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Instance spawned successfully.
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:07:07 user nova-compute[76870]: INFO nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 20 15:07:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:07:08 user nova-compute[76870]: INFO nova.compute.manager [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Took 7.02 seconds to build instance.
Oct 20 15:07:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dcc2c1a0-6871-4c5c-b3b9-ed5770091e67 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.164s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a7288e5-eba4-4de4-8865-b30b1880b3cd req-030e9714-9ffb-431f-8bae-6adba25e6b7a service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:07:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a7288e5-eba4-4de4-8865-b30b1880b3cd req-030e9714-9ffb-431f-8bae-6adba25e6b7a service nova] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a7288e5-eba4-4de4-8865-b30b1880b3cd req-030e9714-9ffb-431f-8bae-6adba25e6b7a service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a7288e5-eba4-4de4-8865-b30b1880b3cd req-030e9714-9ffb-431f-8bae-6adba25e6b7a service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:08 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a7288e5-eba4-4de4-8865-b30b1880b3cd req-030e9714-9ffb-431f-8bae-6adba25e6b7a service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] No waiting events found dispatching network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:07:08 user nova-compute[76870]: WARNING nova.compute.manager [req-8a7288e5-eba4-4de4-8865-b30b1880b3cd req-030e9714-9ffb-431f-8bae-6adba25e6b7a service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received unexpected event network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 for instance with vm_state active and task_state None.
Oct 20 15:07:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid eb6106d9-370f-4384-b45c-92965eea5b98 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "eb6106d9-370f-4384-b45c-92965eea5b98" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "a15d285b-c295-4a79-abd5-d535155130f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "eb6106d9-370f-4384-b45c-92965eea5b98" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "a15d285b-c295-4a79-abd5-d535155130f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:07:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:07:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:07:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:07:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-changed-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Refreshing instance network info cache due to event network-changed-2f178107-7d24-4784-9d8b-b3627563e74f. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] Acquiring lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] Acquired lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Refreshing network info cache for port 2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updated VIF entry in instance network info cache for port 2f178107-7d24-4784-9d8b-b3627563e74f. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:07:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9b15e4bc-2b46-4dd5-afdf-57e2393f90bb req-cfc3911e-e8f5-4374-bbd8-b9bbb8a847e6 service nova] Releasing lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:07:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:07:56 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:07:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:07:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:02 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:08:02 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:08:02 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.101940155029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance eb6106d9-370f-4384-b45c-92965eea5b98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:08:03 user nova-compute[76870]: INFO nova.compute.claims [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Claim successful on node user
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:08:03 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:08:03 user nova-compute[76870]: DEBUG nova.policy [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '407faf0fe9f44219a2d0580e9819f8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710a95fd9def4ae08263d4cdafbdffd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:08:03 user nova-compute[76870]: INFO nova.virt.block_device [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Booting with volume 7be3fa56-1f41-404a-8d2f-cc5b30190b70 at /dev/vda
Oct 20 15:08:04 user nova-compute[76870]: DEBUG os_brick.utils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e635e32d-e197-416e-825e-75d704cec30b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea7b1c0-c9a5-45dd-a68a-5099ec573bc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc1db2-7c7b-4238-8790-dec38e70329b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97032526-ed4a-4ced-b4f7-1696d97f53bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:08:04 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaff074-4cd5-4cfa-a406-59dbd8b8dccb]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG os_brick.utils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updating existing volume attachment record: f6732271-f431-4acd-a2a7-1d9d14d363f3 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Successfully created port: 5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:08:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Successfully updated port: 5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquired lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-changed-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Refreshing instance network info cache due to event network-changed-5e273886-ae49-4cbd-8206-cb6e84a9715a. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:08:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] Acquiring lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updating instance_info_cache with network_info: [{"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Releasing lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Instance network_info: |[{"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] Acquired lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Refreshing network info cache for port 5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updated VIF entry in instance network info cache for port 5e273886-ae49-4cbd-8206-cb6e84a9715a. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updating instance_info_cache with network_info: [{"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:08:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-41d6b1e3-6405-4cbb-9efb-0ddef12bd660 req-341303cf-de7b-43d7-93ec-e46d7d2bec14 service nova] Releasing lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:08:07 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:08:20 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Creating image(s)
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Ensure instance console log exists: /opt/stack/data/nova/instances/e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Start _get_guest_xml network_info=[{"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f6732271-f431-4acd-a2a7-1d9d14d363f3', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sphSMrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2', 'attached_at': '', 'detached_at': '', 'volume_id': '7be3fa56-1f41-404a-8d2f-cc5b30190b70', 'serial': '7be3fa56-1f41-404a-8d2f-cc5b30190b70'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:08:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:08:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sphSMrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:08:20 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:08:20 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:08:20 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ce71c-355a-4cce-900d-ac6293ae2bb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:08:20 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a289e-59e5-4e87-876b-f9c305853cb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70] added
Oct 20 15:08:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3fcc33-45c2-4e6e-82f2-2ec846d8b0b4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b42669-54e6-448e-b7ce-b4a82634ce07]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sphSMrOn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sphSMrOn" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7514e1ac-b6b2-471b-8b3a-4212f52dc911]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sphSMrOn'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3291bf-2920-4102-a41c-ec00faddd39d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8335e89-6a10-49bc-b1f7-c17b05271b66]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd9188-26c9-4684-8762-a0c9672b1b5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260]
Oct 20 15:08:20 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260] successful.
Oct 20 15:08:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ccf291-58b4-4f9f-845b-cbf6edb4f18d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c434d-2f3e-43ee-ac15-8b482979a1bf]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:20 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:08:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:20 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:08:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:08:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0394b0cd-6a2f-4c65-adee-530a2a2d879a]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:08:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sphSMrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26330636435303735', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330636435303735', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2071038885',display_name='tempest-TestVolumeBootPattern-server-2071038885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2071038885',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-3i7l320y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:08:04Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.objects.instance [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'pci_devices' on Instance uuid e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:08:22 user nova-compute[76870]:   <uuid>e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2</uuid>
Oct 20 15:08:22 user nova-compute[76870]:   <name>instance-0000002c</name>
Oct 20 15:08:22 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:08:22 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:08:22 user nova-compute[76870]:   <metadata>
Oct 20 15:08:22 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:08:22 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:08:22 user nova-compute[76870]:       <nova:name>tempest-TestVolumeBootPattern-server-2071038885</nova:name>
Oct 20 15:08:22 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:08:20</nova:creationTime>
Oct 20 15:08:22 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:08:22 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:08:22 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:08:22 user nova-compute[76870]:       <nova:owner>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:user uuid="407faf0fe9f44219a2d0580e9819f8ec">tempest-TestVolumeBootPattern-2023237776-project-member</nova:user>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:project uuid="710a95fd9def4ae08263d4cdafbdffd3">tempest-TestVolumeBootPattern-2023237776</nova:project>
Oct 20 15:08:22 user nova-compute[76870]:       </nova:owner>
Oct 20 15:08:22 user nova-compute[76870]:       <nova:ports>
Oct 20 15:08:22 user nova-compute[76870]:         <nova:port uuid="5e273886-ae49-4cbd-8206-cb6e84a9715a">
Oct 20 15:08:22 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 15:08:22 user nova-compute[76870]:         </nova:port>
Oct 20 15:08:22 user nova-compute[76870]:       </nova:ports>
Oct 20 15:08:22 user nova-compute[76870]:     </nova:instance>
Oct 20 15:08:22 user nova-compute[76870]:   </metadata>
Oct 20 15:08:22 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:08:22 user nova-compute[76870]:     <system>
Oct 20 15:08:22 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:08:22 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:08:22 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:08:22 user nova-compute[76870]:       <entry name="serial">e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2</entry>
Oct 20 15:08:22 user nova-compute[76870]:       <entry name="uuid">e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2</entry>
Oct 20 15:08:22 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:08:22 user nova-compute[76870]:     </system>
Oct 20 15:08:22 user nova-compute[76870]:   </sysinfo>
Oct 20 15:08:22 user nova-compute[76870]:   <os>
Oct 20 15:08:22 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:08:22 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:08:22 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:08:22 user nova-compute[76870]:   </os>
Oct 20 15:08:22 user nova-compute[76870]:   <features>
Oct 20 15:08:22 user nova-compute[76870]:     <acpi/>
Oct 20 15:08:22 user nova-compute[76870]:     <apic/>
Oct 20 15:08:22 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:08:22 user nova-compute[76870]:   </features>
Oct 20 15:08:22 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:08:22 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:08:22 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:08:22 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:08:22 user nova-compute[76870]:   </clock>
Oct 20 15:08:22 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:08:22 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:08:22 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:08:22 user nova-compute[76870]:   </cpu>
Oct 20 15:08:22 user nova-compute[76870]:   <devices>
Oct 20 15:08:22 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:08:22 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:08:22 user nova-compute[76870]:       <source dev="/dev/sdc"/>
Oct 20 15:08:22 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:08:22 user nova-compute[76870]:       <serial>7be3fa56-1f41-404a-8d2f-cc5b30190b70</serial>
Oct 20 15:08:22 user nova-compute[76870]:     </disk>
Oct 20 15:08:22 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:08:22 user nova-compute[76870]:       <mac address="fa:16:3e:74:14:0e"/>
Oct 20 15:08:22 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:08:22 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:08:22 user nova-compute[76870]:       <target dev="tap5e273886-ae"/>
Oct 20 15:08:22 user nova-compute[76870]:     </interface>
Oct 20 15:08:22 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:08:22 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2/console.log" append="off"/>
Oct 20 15:08:22 user nova-compute[76870]:     </serial>
Oct 20 15:08:22 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:08:22 user nova-compute[76870]:     <video>
Oct 20 15:08:22 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:08:22 user nova-compute[76870]:     </video>
Oct 20 15:08:22 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:08:22 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:08:22 user nova-compute[76870]:     </rng>
Oct 20 15:08:22 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:08:22 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:08:22 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:08:22 user nova-compute[76870]:     </memballoon>
Oct 20 15:08:22 user nova-compute[76870]:   </devices>
Oct 20 15:08:22 user nova-compute[76870]: </domain>
Oct 20 15:08:22 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2071038885',display_name='tempest-TestVolumeBootPattern-server-2071038885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2071038885',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-3i7l320y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:08:04Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG os_vif [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e52f66f-1a9b-5725-b73e-fb8372182941', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e273886-ae, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e273886-ae, col_values=(('qos', UUID('855c388f-8cea-4cad-b1fb-1939c59aa979')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e273886-ae, col_values=(('external_ids', {'iface-id': '5e273886-ae49-4cbd-8206-cb6e84a9715a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:14:0e', 'vm-uuid': 'e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:22 user nova-compute[76870]: INFO os_vif [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae')
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:08:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] No VIF found with MAC fa:16:3e:74:14:0e, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-1364edb2-60b1-43cc-9441-b1084b491e2e req-bdbab8ff-2168-4718-84e1-2c6e245ace14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1364edb2-60b1-43cc-9441-b1084b491e2e req-bdbab8ff-2168-4718-84e1-2c6e245ace14 service nova] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1364edb2-60b1-43cc-9441-b1084b491e2e req-bdbab8ff-2168-4718-84e1-2c6e245ace14 service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1364edb2-60b1-43cc-9441-b1084b491e2e req-bdbab8ff-2168-4718-84e1-2c6e245ace14 service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-1364edb2-60b1-43cc-9441-b1084b491e2e req-bdbab8ff-2168-4718-84e1-2c6e245ace14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] No waiting events found dispatching network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:08:23 user nova-compute[76870]: WARNING nova.compute.manager [req-1364edb2-60b1-43cc-9441-b1084b491e2e req-bdbab8ff-2168-4718-84e1-2c6e245ace14 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received unexpected event network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a for instance with vm_state building and task_state spawning.
Oct 20 15:08:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:08:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Instance spawned successfully.
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:08:25 user nova-compute[76870]: INFO nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Took 5.01 seconds to spawn the instance on the hypervisor.
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-4535194b-8400-4af6-a118-1985057b3131 req-a9066152-584e-42ec-bb2c-5b5a7e97fc6f service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4535194b-8400-4af6-a118-1985057b3131 req-a9066152-584e-42ec-bb2c-5b5a7e97fc6f service nova] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4535194b-8400-4af6-a118-1985057b3131 req-a9066152-584e-42ec-bb2c-5b5a7e97fc6f service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4535194b-8400-4af6-a118-1985057b3131 req-a9066152-584e-42ec-bb2c-5b5a7e97fc6f service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-4535194b-8400-4af6-a118-1985057b3131 req-a9066152-584e-42ec-bb2c-5b5a7e97fc6f service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] No waiting events found dispatching network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:08:25 user nova-compute[76870]: WARNING nova.compute.manager [req-4535194b-8400-4af6-a118-1985057b3131 req-a9066152-584e-42ec-bb2c-5b5a7e97fc6f service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received unexpected event network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a for instance with vm_state building and task_state spawning.
Oct 20 15:08:25 user nova-compute[76870]: INFO nova.compute.manager [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Took 22.26 seconds to build instance.
Oct 20 15:08:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-edd6f5dd-5841-43dc-8a01-f59af03f48d1 tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.380s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-changed-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:08:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Refreshing instance network info cache due to event network-changed-ba4801b4-d24c-4e79-a59f-6c9d6f715160. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:08:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:08:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:08:27 user nova-compute[76870]: DEBUG nova.network.neutron [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Refreshing network info cache for port ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:08:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updated VIF entry in instance network info cache for port ba4801b4-d24c-4e79-a59f-6c9d6f715160. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:08:28 user nova-compute[76870]: DEBUG nova.network.neutron [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:08:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9c314461-9d67-45d1-b261-208865d718ee req-64a01bf2-330e-4a02-9e5c-ff2af4c36fba service nova] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG nova.objects.instance [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'flavor' on Instance uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:29 user nova-compute[76870]: INFO nova.compute.manager [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Attaching volume f64289cf-5bcb-487a-9c5e-735c47b94979 to /dev/vdb
Oct 20 15:08:29 user nova-compute[76870]: DEBUG os_brick.utils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e22c43f-cf2a-4a48-8b75-caa5dc1a956a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec2bfeb-ca42-4520-b909-e125c47a6db3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b198d410-cfec-4eae-aae9-ff3aefeadd90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1dd917-2844-4c6c-95e6-54ae97bb4448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:08:29 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:08:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a54ed89-4dfa-4751-b44f-50a8fb5391a5]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG os_brick.utils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:08:29 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating existing volume attachment record: 72a02eb2-80f9-41ad-a393-5dd2176316b7 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:08:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPtTNWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:08:45 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:08:45 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:08:45 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5013ea-9491-4bb3-ad88-56a1ba8ef7c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:08:45 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[458cd643-37de-48b7-9314-8c31f7f88879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979] added
Oct 20 15:08:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2903551-47a0-4121-9e3e-0b2b3b485372]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1265cb-cd06-4b68-9d3a-4e5e361e416a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPtTNWQF {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uPtTNWQF" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[869771b3-8da2-40ca-882c-37f9dea20b54]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uPtTNWQF'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424dfa3-28be-4399-8b5d-9455d0c584d6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded5e381-de58-41a4-bbe0-04aab5a15222]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3841ef-dd5d-4b52-a8d1-b475f2a17e42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260]
Oct 20 15:08:46 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260] successful.
Oct 20 15:08:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb1aa3e-e136-4649-a010-b05e7d45747d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84b773e-ebbc-420f-8871-79916dc33b68]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 (non-flash)
Oct 20 15:08:46 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97da3668-b2ef-430f-ab85-ed3dd2822192]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:08:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPtTNWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23563653065323635', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563653065323635', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'flavor' on Instance uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:08:47 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:08:47 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:08:47 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:08:47 user nova-compute[76870]:   <serial>f64289cf-5bcb-487a-9c5e-735c47b94979</serial>
Oct 20 15:08:47 user nova-compute[76870]: </disk>
Oct 20 15:08:47 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No VIF found with MAC fa:16:3e:5a:9f:32, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:08:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-19e852d4-7ad9-4369-84b7-12a0092984b5 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.506s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:08:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:08:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:08:50 user nova-compute[76870]: INFO nova.compute.manager [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Detaching volume f64289cf-5bcb-487a-9c5e-735c47b94979
Oct 20 15:08:50 user nova-compute[76870]: INFO nova.virt.block_device [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Attempting to driver detach volume f64289cf-5bcb-487a-9c5e-735c47b94979 from mountpoint /dev/vdb
Oct 20 15:08:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Attempting to detach device vdb from instance a15d285b-c295-4a79-abd5-d535155130f1 from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:08:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:08:50 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:08:50 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:08:50 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:08:50 user nova-compute[76870]:   <serial>f64289cf-5bcb-487a-9c5e-735c47b94979</serial>
Oct 20 15:08:50 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:08:50 user nova-compute[76870]: </disk>
Oct 20 15:08:50 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:08:50 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully detached device vdb from instance a15d285b-c295-4a79-abd5-d535155130f1 from the persistent domain config.
Oct 20 15:08:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a15d285b-c295-4a79-abd5-d535155130f1 from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:08:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:08:50 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:08:50 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:08:50 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:08:50 user nova-compute[76870]:   <serial>f64289cf-5bcb-487a-9c5e-735c47b94979</serial>
Oct 20 15:08:50 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:08:50 user nova-compute[76870]: </disk>
Oct 20 15:08:50 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:08:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG nova.compute.manager [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:08:52 user nova-compute[76870]: INFO nova.compute.manager [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] instance snapshotting
Oct 20 15:08:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Beginning live snapshot process
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcty817pz/711a2de3016a4c76a997ec20434d4e15.delta 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:52 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcty817pz/711a2de3016a4c76a997ec20434d4e15.delta 1073741824" returned: 0 in 0.049s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 15:08:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:08:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:08:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 15:08:54 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 15:08:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcty817pz/711a2de3016a4c76a997ec20434d4e15.delta /opt/stack/data/nova/instances/snapshots/tmpcty817pz/711a2de3016a4c76a997ec20434d4e15 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:08:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcty817pz/711a2de3016a4c76a997ec20434d4e15.delta /opt/stack/data/nova/instances/snapshots/tmpcty817pz/711a2de3016a4c76a997ec20434d4e15" returned: 0 in 0.665s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:08:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Snapshot extracted, beginning image upload
Oct 20 15:08:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:08:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Snapshot image upload complete
Oct 20 15:08:57 user nova-compute[76870]: INFO nova.compute.manager [None req-20fd0c69-3a20-40be-9d24-89d3ca97c7c8 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Took 5.26 seconds to snapshot the instance on the hypervisor.
Oct 20 15:08:57 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:08:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:09:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:09:02 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid eb6106d9-370f-4384-b45c-92965eea5b98 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:03 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:09:04 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:09:04 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=25.05057144165039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance eb6106d9-370f-4384-b45c-92965eea5b98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:09:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:10 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a15d285b-c295-4a79-abd5-d535155130f1 is timed out.
Oct 20 15:09:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully detached device vdb from instance a15d285b-c295-4a79-abd5-d535155130f1 from the live domain config.
Oct 20 15:09:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uPtTNWQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:09:10 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320a5b3-5a69-4432-aed6-288b762298ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:09:10 user nova-compute[76870]: No targets found.
Oct 20 15:09:10 user nova-compute[76870]: iSNS:
Oct 20 15:09:10 user nova-compute[76870]: No targets found.
Oct 20 15:09:10 user nova-compute[76870]: STATIC:
Oct 20 15:09:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979
Oct 20 15:09:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:09:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:09:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70
Oct 20 15:09:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:09:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:09:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:09:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:09:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:09:10 user nova-compute[76870]: FIRMWARE:
Oct 20 15:09:10 user nova-compute[76870]: No targets found.
Oct 20 15:09:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:09:10 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:09:10 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[042dc0d8-a1ba-44bf-9a28-6b35d384d48b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cbc5bd-c315-4394-93a1-581bb6df5387]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:09:10 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:09:10 user nova-compute[76870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 (non-flash)
Oct 20 15:09:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:09:10 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:09:10 user nova-compute[76870]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 (non-flash)
Oct 20 15:09:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf82b3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8132898-9e9d-488c-8711-54c2a23c4bb3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933a6a2-4a25-44bc-a643-261d20e8fa01]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b93f40d-9932-4323-8e37-16b5d2291d4d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72514127-9f5b-40a2-9fa4-5cf8c54ad10d]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4474209-a97d-4776-8e02-4abaad6e2a59]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:09:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30643cf-19bf-4509-bfbe-5849b122d27e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260]
Oct 20 15:09:11 user nova-compute[76870]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979, portal: 172.16.0.220,3260] successful.
Oct 20 15:09:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64289cf-5bcb-487a-9c5e-735c47b94979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d712d2b6-2337-4eed-9662-ff4a903315ec]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] <== disconnect_volume: return (283ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG nova.objects.instance [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'flavor' on Instance uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:09:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-cd53f9dc-dc6d-4ae5-9958-262d885f452d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.648s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:09:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:09:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:09:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:09:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:09:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:09:50 user nova-compute[76870]: INFO nova.compute.manager [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] instance snapshotting
Oct 20 15:09:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Beginning live snapshot process
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk3nbqm25/26a9b4478077493b882920de467e2bf8.delta 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk3nbqm25/26a9b4478077493b882920de467e2bf8.delta 1073741824" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:51 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 15:09:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:09:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:09:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] COPY block job progress, current cursor: 23003136 final cursor: 75563008 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:09:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:09:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 15:09:53 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 15:09:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk3nbqm25/26a9b4478077493b882920de467e2bf8.delta /opt/stack/data/nova/instances/snapshots/tmpk3nbqm25/26a9b4478077493b882920de467e2bf8 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk3nbqm25/26a9b4478077493b882920de467e2bf8.delta /opt/stack/data/nova/instances/snapshots/tmpk3nbqm25/26a9b4478077493b882920de467e2bf8" returned: 0 in 0.467s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Snapshot extracted, beginning image upload
Oct 20 15:09:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:54 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-changed-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG nova.compute.manager [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Refreshing instance network info cache due to event network-changed-5e273886-ae49-4cbd-8206-cb6e84a9715a. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] Acquiring lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] Acquired lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Refreshing network info cache for port 5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updated VIF entry in instance network info cache for port 5e273886-ae49-4cbd-8206-cb6e84a9715a. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG nova.network.neutron [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updating instance_info_cache with network_info: [{"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:09:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f857f807-4337-4a76-8a89-c8f21bee87b4 req-da330967-e484-486e-a6ba-58fffd8cd26d service nova] Releasing lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:09:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Snapshot image upload complete
Oct 20 15:09:56 user nova-compute[76870]: INFO nova.compute.manager [None req-11fd9604-ec9c-4c21-a97d-5962e89d8540 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Took 5.58 seconds to snapshot the instance on the hypervisor.
Oct 20 15:09:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-changed-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Refreshing instance network info cache due to event network-changed-5e273886-ae49-4cbd-8206-cb6e84a9715a. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] Acquiring lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] Acquired lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Refreshing network info cache for port 5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:57 user nova-compute[76870]: INFO nova.compute.manager [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Terminating instance
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-7898fb2a-5d1a-4062-81e5-aca41b7332ce req-df994907-26bb-47b8-a996-0ffea7ff3133 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-vif-unplugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7898fb2a-5d1a-4062-81e5-aca41b7332ce req-df994907-26bb-47b8-a996-0ffea7ff3133 service nova] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7898fb2a-5d1a-4062-81e5-aca41b7332ce req-df994907-26bb-47b8-a996-0ffea7ff3133 service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7898fb2a-5d1a-4062-81e5-aca41b7332ce req-df994907-26bb-47b8-a996-0ffea7ff3133 service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-7898fb2a-5d1a-4062-81e5-aca41b7332ce req-df994907-26bb-47b8-a996-0ffea7ff3133 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] No waiting events found dispatching network-vif-unplugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-7898fb2a-5d1a-4062-81e5-aca41b7332ce req-df994907-26bb-47b8-a996-0ffea7ff3133 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-vif-unplugged-5e273886-ae49-4cbd-8206-cb6e84a9715a for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updated VIF entry in instance network info cache for port 5e273886-ae49-4cbd-8206-cb6e84a9715a. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG nova.network.neutron [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updating instance_info_cache with network_info: [{"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:09:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d6de2d6e-950f-4fe0-9d5c-cf5936c8f622 req-4eb2e494-373d-4743-a9fd-92ae947f06f7 service nova] Releasing lock "refresh_cache-e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:09:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Instance destroyed successfully.
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.objects.instance [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'resources' on Instance uuid e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2071038885',display_name='tempest-TestVolumeBootPattern-server-2071038885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2071038885',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:08:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-3i7l320y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:08:26Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "address": "fa:16:3e:74:14:0e", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e273886-ae", "ovs_interfaceid": "5e273886-ae49-4cbd-8206-cb6e84a9715a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_vif [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e273886-ae, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=855c388f-8cea-4cad-b1fb-1939c59aa979) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:09:58 user nova-compute[76870]: INFO os_vif [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=5e273886-ae49-4cbd-8206-cb6e84a9715a,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e273886-ae')
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sphSMrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:09:58 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d316cc-b699-4345-9946-e61399b177af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:09:58 user nova-compute[76870]: No targets found.
Oct 20 15:09:58 user nova-compute[76870]: iSNS:
Oct 20 15:09:58 user nova-compute[76870]: No targets found.
Oct 20 15:09:58 user nova-compute[76870]: STATIC:
Oct 20 15:09:58 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70
Oct 20 15:09:58 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:09:58 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:09:58 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:09:58 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:09:58 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:09:58 user nova-compute[76870]: FIRMWARE:
Oct 20 15:09:58 user nova-compute[76870]: No targets found.
Oct 20 15:09:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:09:58 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:09:58 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdbb660-9779-40e4-b822-736159fa60a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c20eb-08f3-4ef9-84e3-de3d2d23ae6f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:09:58 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:09:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:09:58 user nova-compute[76870]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 (non-flash)
Oct 20 15:09:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8495240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a263a5d-c952-4539-8c6c-89ddb167fcbe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90e99e9-616d-4b07-bb94-e12775416287]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f137038-047a-4fe4-a2b7-387150121944]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cd7a3b-df3a-49fb-bc83-981bfaef425c]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26330636435303735', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d2dc2c88', '/dev/disk/by-id/scsi-1SCST_BIOd2dc2c88-c0cd5075d8418940') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e62275-d906-4482-83ed-09153c49c367]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c7ee4a-99ba-4fbf-8bde-5e1ed453e50b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[59755436-29fa-4cc9-8cf2-2219814606df]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260]
Oct 20 15:09:58 user nova-compute[76870]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70, portal: 172.16.0.220,3260] successful.
Oct 20 15:09:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be3fa56-1f41-404a-8d2f-cc5b30190b70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[820efb94-a4a9-450f-98ef-536fc757d11c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== disconnect_volume: return (311ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:09:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Deleting instance files /opt/stack/data/nova/instances/e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2_del
Oct 20 15:09:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Deletion of /opt/stack/data/nova/instances/e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2_del complete
Oct 20 15:09:58 user nova-compute[76870]: INFO nova.compute.manager [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:58 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:09:58 user nova-compute[76870]: INFO nova.compute.claims [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Claim successful on node user
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:09:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:09:59 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Took 0.94 seconds to deallocate network for instance.
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.compute.manager [req-570667a9-3d24-4a3c-85cf-246dd520b7fa req-6f34d160-46ee-4485-9736-54a752a246d2 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-vif-deleted-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:09:59 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Creating image(s)
Oct 20 15:09:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "/opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "/opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "/opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:09:59 user nova-compute[76870]: DEBUG nova.policy [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '121e9739ffb740a3bfc065653a688438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e4b60edd64426696234f2fdff0f4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:00 user nova-compute[76870]: INFO nova.compute.manager [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Took 1.26 seconds to detach 1 volumes for instance.
Oct 20 15:10:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-d0fdd241-af2f-422e-b86d-877e16881c62 req-b147c7a0-26f5-4328-98a2-4c1a266d2d12 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received event network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d0fdd241-af2f-422e-b86d-877e16881c62 req-b147c7a0-26f5-4328-98a2-4c1a266d2d12 service nova] Acquiring lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d0fdd241-af2f-422e-b86d-877e16881c62 req-b147c7a0-26f5-4328-98a2-4c1a266d2d12 service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d0fdd241-af2f-422e-b86d-877e16881c62 req-b147c7a0-26f5-4328-98a2-4c1a266d2d12 service nova] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-d0fdd241-af2f-422e-b86d-877e16881c62 req-b147c7a0-26f5-4328-98a2-4c1a266d2d12 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] No waiting events found dispatching network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:10:00 user nova-compute[76870]: WARNING nova.compute.manager [req-d0fdd241-af2f-422e-b86d-877e16881c62 req-b147c7a0-26f5-4328-98a2-4c1a266d2d12 service nova] [instance: e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2] Received unexpected event network-vif-plugged-5e273886-ae49-4cbd-8206-cb6e84a9715a for instance with vm_state active and task_state deleting.
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.part --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG nova.virt.images [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] 1cc5af36-c5d1-4956-b3df-8f162596c3b0 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.part /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.384s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:10:01 user nova-compute[76870]: INFO nova.compute.claims [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Claim successful on node user
Oct 20 15:10:01 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Deleted allocations for instance e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Successfully created port: f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.part /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.converted" returned: 0 in 0.781s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9e0f68f4-473a-4819-9818-c0f448f878db tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "e980d8e6-a34c-4fc2-b0c9-24bd8d9050a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.342s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.254s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:10:01 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:10:01 user nova-compute[76870]: INFO nova.virt.block_device [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Booting with blank volume at /dev/vda
Oct 20 15:10:01 user nova-compute[76870]: DEBUG nova.policy [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3271422bfb4145dbad9e30dc8799aeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f01dd35514c0d98db23904e4ad1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617 --force-share --output=json" returned: 0 in 0.190s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617 --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617,backing_fmt=raw /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Successfully updated port: f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-changed-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.compute.manager [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Refreshing instance network info cache due to event network-changed-f4bd23c1-4598-438d-ae7a-650f886fa67b. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] Acquiring lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] Acquired lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Refreshing network info cache for port f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617,backing_fmt=raw /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk 1073741824" returned: 0 in 0.068s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e310ffb8d44f7b550b7b55ab8b1b75f69a6e0617 --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Ensure instance console log exists: /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-296b222a-b6f1-4550-85b0-2c78e364b8c5 req-c5faf825-dc7e-40a3-8012-370e1e06cf47 service nova] Releasing lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquired lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Successfully created port: c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updating instance_info_cache with network_info: [{"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Releasing lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Instance network_info: |[{"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Start _get_guest_xml network_info=[{"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='89cd9ec7dd6e6e2a834d59d4d4a778f0',container_format='bare',created_at=2023-10-20T15:09:51Z,direct_url=<?>,disk_format='qcow2',id=1cc5af36-c5d1-4956-b3df-8f162596c3b0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1210384952',owner='d5e4b60edd64426696234f2fdff0f4a1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T15:09:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': '1cc5af36-c5d1-4956-b3df-8f162596c3b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:10:02 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:10:02 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='89cd9ec7dd6e6e2a834d59d4d4a778f0',container_format='bare',created_at=2023-10-20T15:09:51Z,direct_url=<?>,disk_format='qcow2',id=1cc5af36-c5d1-4956-b3df-8f162596c3b0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1210384952',owner='d5e4b60edd64426696234f2fdff0f4a1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T15:09:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-232506540',display_name='tempest-TestStampPattern-server-232506540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-232506540',id=45,image_ref='1cc5af36-c5d1-4956-b3df-8f162596c3b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6R61bltWmFa4FN/tWsYq0yxOivPOQKTAZeSQ5dsXkeubEsA2nCFaQStvXLxjmWo+g7lDxjht2O1Ocr4vblBDS8eTt8LrHcMZl0qklvkcI+40/AmthHciFjuWJkDB4Dw==',key_name='tempest-TestStampPattern-738172330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e4b60edd64426696234f2fdff0f4a1',ramdisk_id='',reservation_id='r-m83br0l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a15d285b-c295-4a79-abd5-d535155130f1',image_min_disk='1',image_min_ram='0',image_owner_id='d5e4b60edd64426696234f2fdff0f4a1',image_owner_project_name='tempest-TestStampPattern-1703985163',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1703985163-project-member',image_user_id='121e9739ffb740a3bfc065653a688438',network_allocated='True',owner_project_name='tempest-TestStampPattern-1703985163',owner_user_name='tempest-TestStampPattern-1703985163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:09:59Z,user_data=None,user_id='121e9739ffb740a3bfc065653a688438',uuid=18184908-3352-4fce-95f5-fdfef9ccbbac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converting VIF {"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'pci_devices' on Instance uuid 18184908-3352-4fce-95f5-fdfef9ccbbac {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:10:02 user nova-compute[76870]:   <uuid>18184908-3352-4fce-95f5-fdfef9ccbbac</uuid>
Oct 20 15:10:02 user nova-compute[76870]:   <name>instance-0000002d</name>
Oct 20 15:10:02 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:10:02 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:10:02 user nova-compute[76870]:   <metadata>
Oct 20 15:10:02 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:10:02 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:10:02 user nova-compute[76870]:       <nova:name>tempest-TestStampPattern-server-232506540</nova:name>
Oct 20 15:10:02 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:10:02</nova:creationTime>
Oct 20 15:10:02 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:10:02 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:10:02 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:10:02 user nova-compute[76870]:       <nova:owner>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:user uuid="121e9739ffb740a3bfc065653a688438">tempest-TestStampPattern-1703985163-project-member</nova:user>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:project uuid="d5e4b60edd64426696234f2fdff0f4a1">tempest-TestStampPattern-1703985163</nova:project>
Oct 20 15:10:02 user nova-compute[76870]:       </nova:owner>
Oct 20 15:10:02 user nova-compute[76870]:       <nova:root type="image" uuid="1cc5af36-c5d1-4956-b3df-8f162596c3b0"/>
Oct 20 15:10:02 user nova-compute[76870]:       <nova:ports>
Oct 20 15:10:02 user nova-compute[76870]:         <nova:port uuid="f4bd23c1-4598-438d-ae7a-650f886fa67b">
Oct 20 15:10:02 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 15:10:02 user nova-compute[76870]:         </nova:port>
Oct 20 15:10:02 user nova-compute[76870]:       </nova:ports>
Oct 20 15:10:02 user nova-compute[76870]:     </nova:instance>
Oct 20 15:10:02 user nova-compute[76870]:   </metadata>
Oct 20 15:10:02 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:10:02 user nova-compute[76870]:     <system>
Oct 20 15:10:02 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:10:02 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:10:02 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:10:02 user nova-compute[76870]:       <entry name="serial">18184908-3352-4fce-95f5-fdfef9ccbbac</entry>
Oct 20 15:10:02 user nova-compute[76870]:       <entry name="uuid">18184908-3352-4fce-95f5-fdfef9ccbbac</entry>
Oct 20 15:10:02 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:10:02 user nova-compute[76870]:     </system>
Oct 20 15:10:02 user nova-compute[76870]:   </sysinfo>
Oct 20 15:10:02 user nova-compute[76870]:   <os>
Oct 20 15:10:02 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:10:02 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:10:02 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:10:02 user nova-compute[76870]:   </os>
Oct 20 15:10:02 user nova-compute[76870]:   <features>
Oct 20 15:10:02 user nova-compute[76870]:     <acpi/>
Oct 20 15:10:02 user nova-compute[76870]:     <apic/>
Oct 20 15:10:02 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:10:02 user nova-compute[76870]:   </features>
Oct 20 15:10:02 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:10:02 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:10:02 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:10:02 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:10:02 user nova-compute[76870]:   </clock>
Oct 20 15:10:02 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:10:02 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:10:02 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:10:02 user nova-compute[76870]:   </cpu>
Oct 20 15:10:02 user nova-compute[76870]:   <devices>
Oct 20 15:10:02 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:10:02 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:10:02 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk"/>
Oct 20 15:10:02 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:10:02 user nova-compute[76870]:     </disk>
Oct 20 15:10:02 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:10:02 user nova-compute[76870]:       <mac address="fa:16:3e:9c:8a:61"/>
Oct 20 15:10:02 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:10:02 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:10:02 user nova-compute[76870]:       <target dev="tapf4bd23c1-45"/>
Oct 20 15:10:02 user nova-compute[76870]:     </interface>
Oct 20 15:10:02 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:10:02 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/console.log" append="off"/>
Oct 20 15:10:02 user nova-compute[76870]:     </serial>
Oct 20 15:10:02 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:10:02 user nova-compute[76870]:     <video>
Oct 20 15:10:02 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:10:02 user nova-compute[76870]:     </video>
Oct 20 15:10:02 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:10:02 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:10:02 user nova-compute[76870]:     </rng>
Oct 20 15:10:02 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:10:02 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:10:02 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:10:02 user nova-compute[76870]:     </memballoon>
Oct 20 15:10:02 user nova-compute[76870]:   </devices>
Oct 20 15:10:02 user nova-compute[76870]: </domain>
Oct 20 15:10:02 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-232506540',display_name='tempest-TestStampPattern-server-232506540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-232506540',id=45,image_ref='1cc5af36-c5d1-4956-b3df-8f162596c3b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6R61bltWmFa4FN/tWsYq0yxOivPOQKTAZeSQ5dsXkeubEsA2nCFaQStvXLxjmWo+g7lDxjht2O1Ocr4vblBDS8eTt8LrHcMZl0qklvkcI+40/AmthHciFjuWJkDB4Dw==',key_name='tempest-TestStampPattern-738172330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e4b60edd64426696234f2fdff0f4a1',ramdisk_id='',reservation_id='r-m83br0l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a15d285b-c295-4a79-abd5-d535155130f1',image_min_disk='1',image_min_ram='0',image_owner_id='d5e4b60edd64426696234f2fdff0f4a1',image_owner_project_name='tempest-TestStampPattern-1703985163',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1703985163-project-member',image_user_id='121e9739ffb740a3bfc065653a688438',network_allocated='True',owner_project_name='tempest-TestStampPattern-1703985163',owner_user_name='tempest-TestStampPattern-1703985163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:09:59Z,user_data=None,user_id='121e9739ffb740a3bfc065653a688438',uuid=18184908-3352-4fce-95f5-fdfef9ccbbac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converting VIF {"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG os_vif [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9029e364-db3d-5765-a35a-ee9bf34bdc30', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4bd23c1-45, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4bd23c1-45, col_values=(('qos', UUID('564b0f7a-769b-4495-8267-783f17894ee8')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4bd23c1-45, col_values=(('external_ids', {'iface-id': 'f4bd23c1-4598-438d-ae7a-650f886fa67b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:8a:61', 'vm-uuid': '18184908-3352-4fce-95f5-fdfef9ccbbac'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:10:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:02 user nova-compute[76870]: INFO os_vif [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45')
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No VIF found with MAC fa:16:3e:9c:8a:61, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Successfully updated port: c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-changed-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Refreshing instance network info cache due to event network-changed-c4e6ab6d-fc28-44d7-8786-af1cd4986412. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance network_info: |[{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Refreshing network info cache for port c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:10:03 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updated VIF entry in instance network info cache for port c4e6ab6d-fc28-44d7-8786-af1cd4986412. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3e93b28b-0178-4ed4-95a0-51e8bdd1d9d4 req-9add3101-9058-4e39-aaa7-081289d94775 service nova] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-bbdafcab-5890-4e63-8b2e-edcb33fc917d req-28a205d5-f344-47e2-a971-dbbeaff98b7b service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bbdafcab-5890-4e63-8b2e-edcb33fc917d req-28a205d5-f344-47e2-a971-dbbeaff98b7b service nova] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bbdafcab-5890-4e63-8b2e-edcb33fc917d req-28a205d5-f344-47e2-a971-dbbeaff98b7b service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bbdafcab-5890-4e63-8b2e-edcb33fc917d req-28a205d5-f344-47e2-a971-dbbeaff98b7b service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-bbdafcab-5890-4e63-8b2e-edcb33fc917d req-28a205d5-f344-47e2-a971-dbbeaff98b7b service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] No waiting events found dispatching network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:10:04 user nova-compute[76870]: WARNING nova.compute.manager [req-bbdafcab-5890-4e63-8b2e-edcb33fc917d req-28a205d5-f344-47e2-a971-dbbeaff98b7b service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received unexpected event network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b for instance with vm_state building and task_state spawning.
Oct 20 15:10:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:04 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:10:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8642MB free_disk=24.89745330810547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-626da2f4-d622-4e83-9b3d-9b5aee0335d8 req-6b403644-98fe-482c-8e28-9136a1e10d53 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-626da2f4-d622-4e83-9b3d-9b5aee0335d8 req-6b403644-98fe-482c-8e28-9136a1e10d53 service nova] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-626da2f4-d622-4e83-9b3d-9b5aee0335d8 req-6b403644-98fe-482c-8e28-9136a1e10d53 service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-626da2f4-d622-4e83-9b3d-9b5aee0335d8 req-6b403644-98fe-482c-8e28-9136a1e10d53 service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-626da2f4-d622-4e83-9b3d-9b5aee0335d8 req-6b403644-98fe-482c-8e28-9136a1e10d53 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] No waiting events found dispatching network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:10:06 user nova-compute[76870]: WARNING nova.compute.manager [req-626da2f4-d622-4e83-9b3d-9b5aee0335d8 req-6b403644-98fe-482c-8e28-9136a1e10d53 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received unexpected event network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b for instance with vm_state building and task_state spawning.
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance eb6106d9-370f-4384-b45c-92965eea5b98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 18184908-3352-4fce-95f5-fdfef9ccbbac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:10:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Instance spawned successfully.
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:06 user nova-compute[76870]: INFO nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Took 7.36 seconds to spawn the instance on the hypervisor.
Oct 20 15:10:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:10:06 user nova-compute[76870]: INFO nova.compute.manager [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Took 8.06 seconds to build instance.
Oct 20 15:10:07 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3522d948-a4f5-47d5-8fc1-a7b691e9fffb tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.165s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG os_brick.utils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f9a94a-76c0-44bd-bc73-c986ba9fd0dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f49c203-994d-455a-891d-f2f9154918e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8237dc-cde8-4c13-a37a-6f151d259c8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97fe29a-3c57-44d3-b35c-792f3be9c9a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:10:07 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:10:07 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ee94f-f59e-43a0-9c4b-e55523ac41ed]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG os_brick.utils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating existing volume attachment record: 8ae9e33e-cecd-4c91-ac57-a37ce744a479 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:10:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:10:24 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Creating image(s)
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Ensure instance console log exists: /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Start _get_guest_xml network_info=[{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ae9e33e-cecd-4c91-ac57-a37ce744a479', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424', 'attached_at': '', 'detached_at': '', 'volume_id': 'a815a88b-6206-4be6-9c18-eaabd121a6fd', 'serial': 'a815a88b-6206-4be6-9c18-eaabd121a6fd'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:10:24 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:10:24 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:10:24 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:10:24 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:10:24 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c4c5c-1b94-43f6-9d4d-b1c0d2b4779e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:10:24 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75eb7f-16c4-4905-8275-9dc8056874bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd] added
Oct 20 15:10:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac72e9-2973-42ac-8c25-c2af32494c1f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d36fb8-6d16-46a2-ab05-12dc656c70b5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwWRMEGv {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwWRMEGv" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d0399-091e-4dda-bc00-b528ccc5fda5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwWRMEGv'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[531f5174-45b4-4784-a66d-558f68dae30c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[392b62ea-23d8-4740-9597-384c40ab0f22]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:10:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:10:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6199fdae-e4dc-49dc-9073-ad272cd01678]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260]
Oct 20 15:10:24 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260] successful.
Oct 20 15:10:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4975635b-14be-43ed-87f1-0b6e6bfaae6b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3144c4-eafd-48f9-88df-178ecdabfd61]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:10:24 user nova-compute[76870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:10:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:10:24 user nova-compute[76870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:10:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b578c-3d97-484f-8ee0-7ed740b0ef87]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:10:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26263633339323866', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263633339323866', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-740900847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-740900847',id=46,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-daazh38d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:10:02Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.objects.instance [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:10:25 user nova-compute[76870]:   <uuid>c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424</uuid>
Oct 20 15:10:25 user nova-compute[76870]:   <name>instance-0000002e</name>
Oct 20 15:10:25 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:10:25 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:10:25 user nova-compute[76870]:   <metadata>
Oct 20 15:10:25 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:10:25 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:10:25 user nova-compute[76870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-740900847</nova:name>
Oct 20 15:10:25 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:10:24</nova:creationTime>
Oct 20 15:10:25 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:10:25 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:10:25 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:10:25 user nova-compute[76870]:       <nova:owner>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:user uuid="3271422bfb4145dbad9e30dc8799aeb6">tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member</nova:user>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:project uuid="335f01dd35514c0d98db23904e4ad1d3">tempest-ServerBootFromVolumeStableRescueTest-1789045836</nova:project>
Oct 20 15:10:25 user nova-compute[76870]:       </nova:owner>
Oct 20 15:10:25 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:10:25 user nova-compute[76870]:       <nova:ports>
Oct 20 15:10:25 user nova-compute[76870]:         <nova:port uuid="c4e6ab6d-fc28-44d7-8786-af1cd4986412">
Oct 20 15:10:25 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 15:10:25 user nova-compute[76870]:         </nova:port>
Oct 20 15:10:25 user nova-compute[76870]:       </nova:ports>
Oct 20 15:10:25 user nova-compute[76870]:     </nova:instance>
Oct 20 15:10:25 user nova-compute[76870]:   </metadata>
Oct 20 15:10:25 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:10:25 user nova-compute[76870]:     <system>
Oct 20 15:10:25 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:10:25 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:10:25 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:10:25 user nova-compute[76870]:       <entry name="serial">c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424</entry>
Oct 20 15:10:25 user nova-compute[76870]:       <entry name="uuid">c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424</entry>
Oct 20 15:10:25 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:10:25 user nova-compute[76870]:     </system>
Oct 20 15:10:25 user nova-compute[76870]:   </sysinfo>
Oct 20 15:10:25 user nova-compute[76870]:   <os>
Oct 20 15:10:25 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:10:25 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:10:25 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:10:25 user nova-compute[76870]:   </os>
Oct 20 15:10:25 user nova-compute[76870]:   <features>
Oct 20 15:10:25 user nova-compute[76870]:     <acpi/>
Oct 20 15:10:25 user nova-compute[76870]:     <apic/>
Oct 20 15:10:25 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:10:25 user nova-compute[76870]:   </features>
Oct 20 15:10:25 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:10:25 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:10:25 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:10:25 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:10:25 user nova-compute[76870]:   </clock>
Oct 20 15:10:25 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:10:25 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:10:25 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:10:25 user nova-compute[76870]:   </cpu>
Oct 20 15:10:25 user nova-compute[76870]:   <devices>
Oct 20 15:10:25 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:10:25 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:10:25 user nova-compute[76870]:       <source dev="/dev/sdc"/>
Oct 20 15:10:25 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:10:25 user nova-compute[76870]:       <serial>a815a88b-6206-4be6-9c18-eaabd121a6fd</serial>
Oct 20 15:10:25 user nova-compute[76870]:     </disk>
Oct 20 15:10:25 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:10:25 user nova-compute[76870]:       <mac address="fa:16:3e:d1:19:8c"/>
Oct 20 15:10:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:10:25 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:10:25 user nova-compute[76870]:       <target dev="tapc4e6ab6d-fc"/>
Oct 20 15:10:25 user nova-compute[76870]:     </interface>
Oct 20 15:10:25 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:10:25 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/console.log" append="off"/>
Oct 20 15:10:25 user nova-compute[76870]:     </serial>
Oct 20 15:10:25 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:10:25 user nova-compute[76870]:     <video>
Oct 20 15:10:25 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:10:25 user nova-compute[76870]:     </video>
Oct 20 15:10:25 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:10:25 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:10:25 user nova-compute[76870]:     </rng>
Oct 20 15:10:25 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:10:25 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:10:25 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:10:25 user nova-compute[76870]:     </memballoon>
Oct 20 15:10:25 user nova-compute[76870]:   </devices>
Oct 20 15:10:25 user nova-compute[76870]: </domain>
Oct 20 15:10:25 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-740900847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-740900847',id=46,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-daazh38d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:10:02Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG os_vif [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11be0f13-3500-5e4e-9e90-3794d124f955', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4e6ab6d-fc, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4e6ab6d-fc, col_values=(('qos', UUID('75a0551d-3c96-4d05-bbe5-aa10aa0cc21b')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4e6ab6d-fc, col_values=(('external_ids', {'iface-id': 'c4e6ab6d-fc28-44d7-8786-af1cd4986412', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:19:8c', 'vm-uuid': 'c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:25 user nova-compute[76870]: INFO os_vif [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc')
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:10:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No VIF found with MAC fa:16:3e:d1:19:8c, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-7e705c82-b690-4d3d-9463-2c965eb573da req-c8452655-0e93-4767-b98d-51d861b3ea4c service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7e705c82-b690-4d3d-9463-2c965eb573da req-c8452655-0e93-4767-b98d-51d861b3ea4c service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7e705c82-b690-4d3d-9463-2c965eb573da req-c8452655-0e93-4767-b98d-51d861b3ea4c service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7e705c82-b690-4d3d-9463-2c965eb573da req-c8452655-0e93-4767-b98d-51d861b3ea4c service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG nova.compute.manager [req-7e705c82-b690-4d3d-9463-2c965eb573da req-c8452655-0e93-4767-b98d-51d861b3ea4c service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:10:27 user nova-compute[76870]: WARNING nova.compute.manager [req-7e705c82-b690-4d3d-9463-2c965eb573da req-c8452655-0e93-4767-b98d-51d861b3ea4c service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state building and task_state spawning.
Oct 20 15:10:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:10:29 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance spawned successfully.
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:10:29 user nova-compute[76870]: INFO nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Took 4.95 seconds to spawn the instance on the hypervisor.
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:10:29 user nova-compute[76870]: INFO nova.compute.manager [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Took 28.55 seconds to build instance.
Oct 20 15:10:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-9a3ee646-5afe-43b3-aa5c-e36d0919e6da tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.740s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-dccb3106-a7af-4ca6-9206-87a0deb92a3e req-ffb11f5b-4fd9-44d9-a692-ba4f02cccc6b service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dccb3106-a7af-4ca6-9206-87a0deb92a3e req-ffb11f5b-4fd9-44d9-a692-ba4f02cccc6b service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dccb3106-a7af-4ca6-9206-87a0deb92a3e req-ffb11f5b-4fd9-44d9-a692-ba4f02cccc6b service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dccb3106-a7af-4ca6-9206-87a0deb92a3e req-ffb11f5b-4fd9-44d9-a692-ba4f02cccc6b service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:10:29 user nova-compute[76870]: DEBUG nova.compute.manager [req-dccb3106-a7af-4ca6-9206-87a0deb92a3e req-ffb11f5b-4fd9-44d9-a692-ba4f02cccc6b service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:10:29 user nova-compute[76870]: WARNING nova.compute.manager [req-dccb3106-a7af-4ca6-9206-87a0deb92a3e req-ffb11f5b-4fd9-44d9-a692-ba4f02cccc6b service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state active and task_state None.
Oct 20 15:10:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:10:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:10:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:10:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:10:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:10:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:10:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:10:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:10:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:10:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:10:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:10:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:10:59 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:11:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:11:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:11:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:11:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-changed-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Refreshing instance network info cache due to event network-changed-2f178107-7d24-4784-9d8b-b3627563e74f. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] Acquiring lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] Acquired lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Refreshing network info cache for port 2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "eb6106d9-370f-4384-b45c-92965eea5b98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:07 user nova-compute[76870]: INFO nova.compute.manager [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Terminating instance
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc33ffe3-536d-44de-8046-4db14e428446 req-adc52936-8c9e-44b2-bf3d-df1cb063ce30 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-vif-unplugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc33ffe3-536d-44de-8046-4db14e428446 req-adc52936-8c9e-44b2-bf3d-df1cb063ce30 service nova] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc33ffe3-536d-44de-8046-4db14e428446 req-adc52936-8c9e-44b2-bf3d-df1cb063ce30 service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-dc33ffe3-536d-44de-8046-4db14e428446 req-adc52936-8c9e-44b2-bf3d-df1cb063ce30 service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc33ffe3-536d-44de-8046-4db14e428446 req-adc52936-8c9e-44b2-bf3d-df1cb063ce30 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] No waiting events found dispatching network-vif-unplugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-dc33ffe3-536d-44de-8046-4db14e428446 req-adc52936-8c9e-44b2-bf3d-df1cb063ce30 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-vif-unplugged-2f178107-7d24-4784-9d8b-b3627563e74f for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updated VIF entry in instance network info cache for port 2f178107-7d24-4784-9d8b-b3627563e74f. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [{"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:11:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c27cdff8-a840-476c-a9e5-3dbc1b73ad2e req-a9e51b4f-1c7f-44b8-a1e5-99feaba166f1 service nova] Releasing lock "refresh_cache-eb6106d9-370f-4384-b45c-92965eea5b98" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Instance destroyed successfully.
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lazy-loading 'resources' on Instance uuid eb6106d9-370f-4384-b45c-92965eea5b98 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1738241168',display_name='tempest-TestVolumeBootPattern-server-1738241168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1738241168',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXmfOBAN+1/inGrFTY7xvNd81fd+Q1kb8ZRsI7v4JsggC7gLzA+sTfBtkeVVNGlS71gbaz4R5ScGyl/Da0kZ8LexBph6+9GMoImTZ3eE7K0MP0A2lWD6gL2V6fI38tuQ==',key_name='tempest-TestVolumeBootPattern-1235320424',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='710a95fd9def4ae08263d4cdafbdffd3',ramdisk_id='',reservation_id='r-fkeg740r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2023237776',owner_user_name='tempest-TestVolumeBootPattern-2023237776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:06:19Z,user_data=None,user_id='407faf0fe9f44219a2d0580e9819f8ec',uuid=eb6106d9-370f-4384-b45c-92965eea5b98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converting VIF {"id": "2f178107-7d24-4784-9d8b-b3627563e74f", "address": "fa:16:3e:2e:d9:a3", "network": {"id": "e90a872e-d18c-4b98-bad2-e58dde2edc27", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1416170310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "710a95fd9def4ae08263d4cdafbdffd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f178107-7d", "ovs_interfaceid": "2f178107-7d24-4784-9d8b-b3627563e74f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_vif [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f178107-7d, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37863ecd-f9ab-49bd-ae59-3b6c361f242a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:08 user nova-compute[76870]: INFO os_vif [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:d9:a3,bridge_name='br-int',has_traffic_filtering=True,id=2f178107-7d24-4784-9d8b-b3627563e74f,network=Network(e90a872e-d18c-4b98-bad2-e58dde2edc27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f178107-7d')
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZOrJEUHy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:11:08 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e8ae5-f33b-457e-9abc-791e8f2198a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:11:08 user nova-compute[76870]: No targets found.
Oct 20 15:11:08 user nova-compute[76870]: iSNS:
Oct 20 15:11:08 user nova-compute[76870]: No targets found.
Oct 20 15:11:08 user nova-compute[76870]: STATIC:
Oct 20 15:11:08 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:11:08 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:11:08 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:11:08 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32
Oct 20 15:11:08 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:11:08 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:11:08 user nova-compute[76870]: FIRMWARE:
Oct 20 15:11:08 user nova-compute[76870]: No targets found.
Oct 20 15:11:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:11:08 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:11:08 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72703aee-41f4-4a24-80c6-a2d2524159c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:11:08 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8502MB free_disk=24.89429473876953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879267f-f834-4b19-8d73-e460cc274c61]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:11:08 user nova-compute[76870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:11:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 (non-flash)
Oct 20 15:11:08 user nova-compute[76870]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:11:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c78fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[72953228-0d33-4e3a-b509-445bc92c45af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da9be1e-58ea-45f3-83a5-610de8dc7bb8]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2356639b-4219-48f2-9366-ce66c3fcf8ee]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f7d6d-be10-4404-afd0-b6a08e7ef565]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance eb6106d9-370f-4384-b45c-92965eea5b98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 18184908-3352-4fce-95f5-fdfef9ccbbac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bd5706-f6fb-4811-817a-1d25cd5fb132]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c7f093-f4a7-47ce-b80b-4db54617e0b7]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260]
Oct 20 15:11:08 user nova-compute[76870]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32, portal: 172.16.0.220,3260] successful.
Oct 20 15:11:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a37a1df-33b8-4532-bd03-1c0698ed8c32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef3fa5-516e-46b6-a4de-e72c28964215]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.653s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] <== disconnect_volume: return (655ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:11:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:11:08 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Deleting instance files /opt/stack/data/nova/instances/eb6106d9-370f-4384-b45c-92965eea5b98_del
Oct 20 15:11:08 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Deletion of /opt/stack/data/nova/instances/eb6106d9-370f-4384-b45c-92965eea5b98_del complete
Oct 20 15:11:09 user nova-compute[76870]: INFO nova.compute.manager [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Took 1.53 seconds to destroy the instance on the hypervisor.
Oct 20 15:11:09 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:11:09 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Took 0.59 seconds to deallocate network for instance.
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] Acquiring lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] Lock "eb6106d9-370f-4384-b45c-92965eea5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] No waiting events found dispatching network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:11:09 user nova-compute[76870]: WARNING nova.compute.manager [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received unexpected event network-vif-plugged-2f178107-7d24-4784-9d8b-b3627563e74f for instance with vm_state active and task_state deleting.
Oct 20 15:11:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-c27111e4-d6b2-4057-83d9-33ad2c858964 req-cfd790be-c7dd-4488-aed8-272ed8cc621f service nova] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Received event network-vif-deleted-2f178107-7d24-4784-9d8b-b3627563e74f {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:10 user nova-compute[76870]: INFO nova.compute.manager [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] [instance: eb6106d9-370f-4384-b45c-92965eea5b98] Took 0.83 seconds to detach 1 volumes for instance.
Oct 20 15:11:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:11:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:11:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:10 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Deleted allocations for instance eb6106d9-370f-4384-b45c-92965eea5b98
Oct 20 15:11:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4dc46741-d55b-42d1-b673-979f7b88ea0f tempest-TestVolumeBootPattern-2023237776 tempest-TestVolumeBootPattern-2023237776-project-member] Lock "eb6106d9-370f-4384-b45c-92965eea5b98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.320s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:11:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:11:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:11:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:11:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-changed-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Refreshing instance network info cache due to event network-changed-f4bd23c1-4598-438d-ae7a-650f886fa67b. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:11:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] Acquiring lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:11:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] Acquired lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:11:50 user nova-compute[76870]: DEBUG nova.network.neutron [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Refreshing network info cache for port f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updated VIF entry in instance network info cache for port f4bd23c1-4598-438d-ae7a-650f886fa67b. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG nova.network.neutron [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updating instance_info_cache with network_info: [{"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-5a6bb4b2-ca02-4c08-9c29-12b54ce922e7 req-339fa61d-69ac-4659-ab60-b56ebb385a8f service nova] Releasing lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'flavor' on Instance uuid 18184908-3352-4fce-95f5-fdfef9ccbbac {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:51 user nova-compute[76870]: INFO nova.compute.manager [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Rescuing
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:51 user nova-compute[76870]: INFO nova.compute.manager [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Attaching volume c5f87f12-25c2-4943-b0b0-bb2f806b544d to /dev/vdb
Oct 20 15:11:51 user nova-compute[76870]: DEBUG os_brick.utils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1272d9-c0cc-453b-b7da-09eba283d411]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8246f919-1d0e-4abe-915a-73e78605886a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[648bf13d-ffd1-458a-be4b-d8d5ef8e6dd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae806bab-67ec-4431-9411-5487992003be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:11:51 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a804c1af-a06b-438e-9d84-f3538f622d99]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG os_brick.utils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updating existing volume attachment record: 8ea77efa-1e5b-40eb-9766-325fa0ebbbc4 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG nova.network.neutron [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance destroyed successfully.
Oct 20 15:11:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Attempting a stable device rescue
Oct 20 15:11:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 15:11:52 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Creating image(s)
Oct 20 15:11:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG nova.objects.instance [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "423ea734cdf1141b90440f32943295c279a02e3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:52 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "423ea734cdf1141b90440f32943295c279a02e3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:11:53 user nova-compute[76870]: WARNING nova.compute.manager [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state active and task_state rescuing.
Oct 20 15:11:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG nova.compute.manager [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:11:53 user nova-compute[76870]: WARNING nova.compute.manager [req-ffbbefb5-12d2-4432-9bb5-b4222314289a req-7ce3413b-65c3-4501-ac44-dd421c9bc3ab service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state active and task_state rescuing.
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.part --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG nova.virt.images [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] 0cfea000-f302-4fd2-a368-fe6aa9d80f21 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 15:11:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.part /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.part /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.converted" returned: 0 in 0.467s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "423ea734cdf1141b90440f32943295c279a02e3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.811s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "423ea734cdf1141b90440f32943295c279a02e3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "423ea734cdf1141b90440f32943295c279a02e3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a,backing_fmt=raw /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/423ea734cdf1141b90440f32943295c279a02e3a,backing_fmt=raw /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue" returned: 0 in 0.058s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "423ea734cdf1141b90440f32943295c279a02e3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'migration_context' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Start _get_guest_xml network_info=[{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "vif_mac": "fa:16:3e:d1:19:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0cfea000-f302-4fd2-a368-fe6aa9d80f21', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ae9e33e-cecd-4c91-ac57-a37ce744a479', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424', 'attached_at': '', 'detached_at': '', 'volume_id': 'a815a88b-6206-4be6-9c18-eaabd121a6fd', 'serial': 'a815a88b-6206-4be6-9c18-eaabd121a6fd'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'resources' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'numa_topology' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:11:54 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:11:54 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:11:54 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:11:54 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:11:54 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd394cf0-7094-42e8-8bdb-ef05139c9c53]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VwWRMEGv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 15:11:54 user nova-compute[76870]: node.name = iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:11:54 user nova-compute[76870]: node.tpgt = -1
Oct 20 15:11:54 user nova-compute[76870]: node.startup = automatic
Oct 20 15:11:54 user nova-compute[76870]: node.leading_login = No
Oct 20 15:11:54 user nova-compute[76870]: iface.iscsi_ifacename = default
Oct 20 15:11:54 user nova-compute[76870]: iface.net_ifacename = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.ipaddress = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.prefix_len = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.hwaddress = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.transport_name = tcp
Oct 20 15:11:54 user nova-compute[76870]: iface.initiatorname = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.vlan_id = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.vlan_priority = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.vlan_state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.iface_num = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.mtu = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.port = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.bootproto = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.subnet_mask = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.gateway = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_alt_client_id = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_dns = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_learn_iqn = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_vendor_id_state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_vendor_id = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.dhcp_slp_da = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.fragmentation = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.gratuitous_arp = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.incoming_forwarding = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.tos_state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.tos = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.ttl = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.delayed_ack = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.tcp_nagle = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.tcp_wsf_state = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.tcp_wsf = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.tcp_timer_scale = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.tcp_timestamp = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.redirect = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.def_task_mgmt_timeout = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.header_digest = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.data_digest = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.immediate_data = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.initial_r2t = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.data_seq_inorder = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.data_pdu_inorder = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.erl = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.max_receive_data_len = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.first_burst_len = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.max_outstanding_r2t = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.max_burst_len = 0
Oct 20 15:11:54 user nova-compute[76870]: iface.chap_auth = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.bidi_chap = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.strict_login_compliance = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.discovery_auth = <empty>
Oct 20 15:11:54 user nova-compute[76870]: iface.discovery_logout = <empty>
Oct 20 15:11:54 user nova-compute[76870]: node.discovery_address = <empty>
Oct 20 15:11:54 user nova-compute[76870]: node.discovery_port = 0
Oct 20 15:11:54 user nova-compute[76870]: node.discovery_type = static
Oct 20 15:11:54 user nova-compute[76870]: node.session.initial_cmdsn = 0
Oct 20 15:11:54 user nova-compute[76870]: node.session.initial_login_retry_max = 8
Oct 20 15:11:54 user nova-compute[76870]: node.session.xmit_thread_priority = -20
Oct 20 15:11:54 user nova-compute[76870]: node.session.cmds_max = 128
Oct 20 15:11:54 user nova-compute[76870]: node.session.queue_depth = 32
Oct 20 15:11:54 user nova-compute[76870]: node.session.nr_sessions = 1
Oct 20 15:11:54 user nova-compute[76870]: node.session.auth.authmethod = CHAP
Oct 20 15:11:54 user nova-compute[76870]: node.session.auth.username = VwWRMEGv
Oct 20 15:11:54 user nova-compute[76870]: node.session.auth.password = ***
Oct 20 15:11:54 user nova-compute[76870]: node.session.auth.username_in = <empty>
Oct 20 15:11:54 user nova-compute[76870]: node.session.auth.password_in = <empty>
Oct 20 15:11:54 user nova-compute[76870]: node.session.auth.chap_algs = MD5
Oct 20 15:11:54 user nova-compute[76870]: node.session.timeo.replacement_timeout = 120
Oct 20 15:11:54 user nova-compute[76870]: node.session.err_timeo.abort_timeout = 15
Oct 20 15:11:54 user nova-compute[76870]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 15:11:54 user nova-compute[76870]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 15:11:54 user nova-compute[76870]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.FastAbort = Yes
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.InitialR2T = No
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.ImmediateData = Yes
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.MaxConnections = 1
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 15:11:54 user nova-compute[76870]: node.session.iscsi.ERL = 0
Oct 20 15:11:54 user nova-compute[76870]: node.session.scan = manual
Oct 20 15:11:54 user nova-compute[76870]: node.session.reopen_max = 0
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].address = 172.16.0.220
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].port = 3260
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].startup = manual
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].tcp.window_size = 524288
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].tcp.type_of_service = 0
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].timeo.logout_timeout = 15
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].timeo.login_timeout = 15
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].timeo.auth_timeout = 45
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].iscsi.DataDigest = None
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].iscsi.IFMarker = No
Oct 20 15:11:54 user nova-compute[76870]: node.conn[0].iscsi.OFMarker = No
Oct 20 15:11:54 user nova-compute[76870]: # END RECORD
Oct 20 15:11:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.095s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[15909fac-877f-4378-9038-6b55296e6cb8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fb757f-cffe-47b8-9014-75e56a2b70d1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwWRMEGv {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwWRMEGv" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10100b5-b85b-4635-8c8b-df1e471d7ea8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwWRMEGv'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[593261f9-976d-4b64-8f50-571c1cfa82e2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4de4ae-bd83-4734-b457-b0c33492b8d9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:11:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:11:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.213s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] HCTL ('34', '0', '0', 0) found on session 46 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21cc4be-0fa6-4d2b-8d74-2d2e1443d3ca]: (4, ('0 0 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching for a device in session 46 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.235s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '26263633339323866', 'path': '/dev/sdc'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263633339323866', 'path': '/dev/sdc'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-740900847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-740900847',id=46,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-daazh38d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:10:29Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "vif_mac": "fa:16:3e:d1:19:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "vif_mac": "fa:16:3e:d1:19:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.objects.base [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:11:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:11:54 user nova-compute[76870]:   <uuid>c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424</uuid>
Oct 20 15:11:54 user nova-compute[76870]:   <name>instance-0000002e</name>
Oct 20 15:11:54 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:11:54 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:11:54 user nova-compute[76870]:   <metadata>
Oct 20 15:11:54 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:11:54 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:11:54 user nova-compute[76870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-740900847</nova:name>
Oct 20 15:11:54 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:11:54</nova:creationTime>
Oct 20 15:11:54 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:11:54 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:11:54 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:11:54 user nova-compute[76870]:       <nova:owner>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:user uuid="3271422bfb4145dbad9e30dc8799aeb6">tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member</nova:user>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:project uuid="335f01dd35514c0d98db23904e4ad1d3">tempest-ServerBootFromVolumeStableRescueTest-1789045836</nova:project>
Oct 20 15:11:54 user nova-compute[76870]:       </nova:owner>
Oct 20 15:11:54 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:11:54 user nova-compute[76870]:       <nova:ports>
Oct 20 15:11:54 user nova-compute[76870]:         <nova:port uuid="c4e6ab6d-fc28-44d7-8786-af1cd4986412">
Oct 20 15:11:54 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 15:11:54 user nova-compute[76870]:         </nova:port>
Oct 20 15:11:54 user nova-compute[76870]:       </nova:ports>
Oct 20 15:11:54 user nova-compute[76870]:     </nova:instance>
Oct 20 15:11:54 user nova-compute[76870]:   </metadata>
Oct 20 15:11:54 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:11:54 user nova-compute[76870]:     <system>
Oct 20 15:11:54 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:11:54 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:11:54 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:11:54 user nova-compute[76870]:       <entry name="serial">c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424</entry>
Oct 20 15:11:54 user nova-compute[76870]:       <entry name="uuid">c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424</entry>
Oct 20 15:11:54 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:11:54 user nova-compute[76870]:     </system>
Oct 20 15:11:54 user nova-compute[76870]:   </sysinfo>
Oct 20 15:11:54 user nova-compute[76870]:   <os>
Oct 20 15:11:54 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:11:54 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:11:54 user nova-compute[76870]:   </os>
Oct 20 15:11:54 user nova-compute[76870]:   <features>
Oct 20 15:11:54 user nova-compute[76870]:     <acpi/>
Oct 20 15:11:54 user nova-compute[76870]:     <apic/>
Oct 20 15:11:54 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:11:54 user nova-compute[76870]:   </features>
Oct 20 15:11:54 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:11:54 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:11:54 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:11:54 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:11:54 user nova-compute[76870]:   </clock>
Oct 20 15:11:54 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:11:54 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:11:54 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:11:54 user nova-compute[76870]:   </cpu>
Oct 20 15:11:54 user nova-compute[76870]:   <devices>
Oct 20 15:11:54 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:11:54 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:11:54 user nova-compute[76870]:       <source dev="/dev/sdc"/>
Oct 20 15:11:54 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:11:54 user nova-compute[76870]:       <serial>a815a88b-6206-4be6-9c18-eaabd121a6fd</serial>
Oct 20 15:11:54 user nova-compute[76870]:     </disk>
Oct 20 15:11:54 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:11:54 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:11:54 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue"/>
Oct 20 15:11:54 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 15:11:54 user nova-compute[76870]:       <boot order="1"/>
Oct 20 15:11:54 user nova-compute[76870]:     </disk>
Oct 20 15:11:54 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:11:54 user nova-compute[76870]:       <mac address="fa:16:3e:d1:19:8c"/>
Oct 20 15:11:54 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:11:54 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:11:54 user nova-compute[76870]:       <target dev="tapc4e6ab6d-fc"/>
Oct 20 15:11:54 user nova-compute[76870]:     </interface>
Oct 20 15:11:54 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:11:54 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/console.log" append="off"/>
Oct 20 15:11:54 user nova-compute[76870]:     </serial>
Oct 20 15:11:54 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:11:54 user nova-compute[76870]:     <video>
Oct 20 15:11:54 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:11:54 user nova-compute[76870]:     </video>
Oct 20 15:11:54 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:11:54 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:11:54 user nova-compute[76870]:     </rng>
Oct 20 15:11:54 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:11:54 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:11:54 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:11:54 user nova-compute[76870]:     </memballoon>
Oct 20 15:11:54 user nova-compute[76870]:   </devices>
Oct 20 15:11:54 user nova-compute[76870]: </domain>
Oct 20 15:11:54 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:11:54 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance destroyed successfully.
Oct 20 15:11:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:11:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:11:55 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No VIF found with MAC fa:16:3e:d1:19:8c, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:11:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-71dea400-98c0-4c9b-ad46-d10e8c42125c req-519e6d88-74f7-40da-977f-4681c26a12f4 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71dea400-98c0-4c9b-ad46-d10e8c42125c req-519e6d88-74f7-40da-977f-4681c26a12f4 service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71dea400-98c0-4c9b-ad46-d10e8c42125c req-519e6d88-74f7-40da-977f-4681c26a12f4 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-71dea400-98c0-4c9b-ad46-d10e8c42125c req-519e6d88-74f7-40da-977f-4681c26a12f4 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-71dea400-98c0-4c9b-ad46-d10e8c42125c req-519e6d88-74f7-40da-977f-4681c26a12f4 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:11:56 user nova-compute[76870]: WARNING nova.compute.manager [req-71dea400-98c0-4c9b-ad46-d10e8c42125c req-519e6d88-74f7-40da-977f-4681c26a12f4 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state active and task_state rescuing.
Oct 20 15:11:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:56 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-196e9d9b-e536-4f4a-9dfd-65d2fe6a1469 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-a3d961a2-2d17-476e-a1cd-84d094544e58 req-34ae35e5-ee52-4e83-9d4b-7a909f924888 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a3d961a2-2d17-476e-a1cd-84d094544e58 req-34ae35e5-ee52-4e83-9d4b-7a909f924888 service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a3d961a2-2d17-476e-a1cd-84d094544e58 req-34ae35e5-ee52-4e83-9d4b-7a909f924888 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a3d961a2-2d17-476e-a1cd-84d094544e58 req-34ae35e5-ee52-4e83-9d4b-7a909f924888 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-a3d961a2-2d17-476e-a1cd-84d094544e58 req-34ae35e5-ee52-4e83-9d4b-7a909f924888 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:11:58 user nova-compute[76870]: WARNING nova.compute.manager [req-a3d961a2-2d17-476e-a1cd-84d094544e58 req-34ae35e5-ee52-4e83-9d4b-7a909f924888 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state rescued and task_state None.
Oct 20 15:11:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:11:58 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:12:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:12:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:12:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:07 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:12:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:12:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:12:07 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:12:07 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EktsbvPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:12:08 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:12:08 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:12:08 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccf36f0-61e8-4aec-9707-5c0bb43b7ae3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:12:08 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[730ca11c-d353-4a95-8251-b1c7c71fc39b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d] added
Oct 20 15:12:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[280d1e82-5d5d-4b35-9085-41cc5aa97a2c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8612a11-41d2-4810-b8bb-4a1ee41af405]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EktsbvPU {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EktsbvPU" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dfdbdf-3cb1-45a6-81db-9d8ed07b70e0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EktsbvPU'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ffe705-0754-45fe-8d80-0c1fb51605ff]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522425c-84f5-4e38-8d58-4f9c28c0282e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:12:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:12:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47843f7f-4e53-498b-b294-dbbadb592b95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260]
Oct 20 15:12:08 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260] successful.
Oct 20 15:12:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5eedad-4846-47a9-83b5-4db8b8feee7c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5230e059-a060-4421-aff8-88db9f041956]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:12:08 user nova-compute[76870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d (non-flash)
Oct 20 15:12:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:12:08 user nova-compute[76870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d (non-flash)
Oct 20 15:12:08 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e66e66-086d-4e98-aa9e-0508e741d022]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:08 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EktsbvPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] <== connect_volume: return (1579ms) {'type': 'block', 'scsi_wwn': '23137376238316536', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137376238316536', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:12:09 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:12:09 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:12:09 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=24.797950744628906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'flavor' on Instance uuid 18184908-3352-4fce-95f5-fdfef9ccbbac {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:12:09 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:12:09 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:12:09 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:12:09 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:12:09 user nova-compute[76870]:   <serial>c5f87f12-25c2-4943-b0b0-bb2f806b544d</serial>
Oct 20 15:12:09 user nova-compute[76870]: </disk>
Oct 20 15:12:09 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 18184908-3352-4fce-95f5-fdfef9ccbbac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] No VIF found with MAC fa:16:3e:9c:8a:61, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b1125fdf-91f9-4ace-a39f-2fabbf1a16a8 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.465s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:12:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:12:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:12:12 user nova-compute[76870]: INFO nova.compute.manager [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Detaching volume c5f87f12-25c2-4943-b0b0-bb2f806b544d
Oct 20 15:12:12 user nova-compute[76870]: INFO nova.virt.block_device [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Attempting to driver detach volume c5f87f12-25c2-4943-b0b0-bb2f806b544d from mountpoint /dev/vdb
Oct 20 15:12:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Attempting to detach device vdb from instance 18184908-3352-4fce-95f5-fdfef9ccbbac from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:12:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:12:12 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:12:12 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:12:12 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:12:12 user nova-compute[76870]:   <serial>c5f87f12-25c2-4943-b0b0-bb2f806b544d</serial>
Oct 20 15:12:12 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:12:12 user nova-compute[76870]: </disk>
Oct 20 15:12:12 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:12:12 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully detached device vdb from instance 18184908-3352-4fce-95f5-fdfef9ccbbac from the persistent domain config.
Oct 20 15:12:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18184908-3352-4fce-95f5-fdfef9ccbbac from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:12:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:12:12 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:12:12 user nova-compute[76870]:   <source dev="/dev/sdb"/>
Oct 20 15:12:12 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:12:12 user nova-compute[76870]:   <serial>c5f87f12-25c2-4943-b0b0-bb2f806b544d</serial>
Oct 20 15:12:12 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:12:12 user nova-compute[76870]: </disk>
Oct 20 15:12:12 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:12:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18184908-3352-4fce-95f5-fdfef9ccbbac {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:12:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:12:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:12:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:12:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:27 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:12:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 18184908-3352-4fce-95f5-fdfef9ccbbac is timed out.
Oct 20 15:12:33 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully detached device vdb from instance 18184908-3352-4fce-95f5-fdfef9ccbbac from the live domain config.
Oct 20 15:12:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EktsbvPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:12:33 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f681c6-bb38-476d-a6b5-47190223e412]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:12:33 user nova-compute[76870]: No targets found.
Oct 20 15:12:33 user nova-compute[76870]: iSNS:
Oct 20 15:12:33 user nova-compute[76870]: No targets found.
Oct 20 15:12:33 user nova-compute[76870]: STATIC:
Oct 20 15:12:33 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d
Oct 20 15:12:33 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:12:33 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:12:33 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:12:33 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:12:33 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:12:33 user nova-compute[76870]: FIRMWARE:
Oct 20 15:12:33 user nova-compute[76870]: No targets found.
Oct 20 15:12:33 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:12:33 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:12:33 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cac709-4710-4ec3-aaf5-d582e6b0b1bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012fef1-1076-48fc-837b-4ad9bbbbc842]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:12:33 user nova-compute[76870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d (non-flash)
Oct 20 15:12:33 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:12:33 user nova-compute[76870]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d (non-flash)
Oct 20 15:12:33 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf84ce7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853fa6e-ec50-47d0-9daf-004c47dff81a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaff9d9-dbdf-4f31-b8ac-f6d203dd4217]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6c16bb-1a8a-46f8-aeed-0fee94c36341]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[17208dca-4577-4a97-b203-3ccaaf07db27]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd3053-12ba-47b0-897f-ec309eab05e5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5999da6e-bd80-4655-a2d3-5201b884495f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260]
Oct 20 15:12:33 user nova-compute[76870]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d, portal: 172.16.0.220,3260] successful.
Oct 20 15:12:33 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f87f12-25c2-4943-b0b0-bb2f806b544d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46348023-0d50-4dbb-9d28-f5c90b574a26]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] <== disconnect_volume: return (321ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:12:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:12:34 user nova-compute[76870]: DEBUG nova.objects.instance [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'flavor' on Instance uuid 18184908-3352-4fce-95f5-fdfef9ccbbac {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:12:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-0b49de92-f74e-4155-8704-c2a8dffdbc30 tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.799s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:12:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:12:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:12:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:12:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:12:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:12:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:12:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:12:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:12:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:12:57 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:12:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:12:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:00 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:13:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-changed-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG nova.compute.manager [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Refreshing instance network info cache due to event network-changed-f4bd23c1-4598-438d-ae7a-650f886fa67b. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] Acquiring lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] Acquired lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG nova.network.neutron [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Refreshing network info cache for port f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:03 user nova-compute[76870]: INFO nova.compute.manager [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Terminating instance
Oct 20 15:13:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-28b72315-fb91-41a5-b311-459c423778d0 req-d32dba64-1143-4d5b-872c-299c3a297422 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-vif-unplugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28b72315-fb91-41a5-b311-459c423778d0 req-d32dba64-1143-4d5b-872c-299c3a297422 service nova] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28b72315-fb91-41a5-b311-459c423778d0 req-d32dba64-1143-4d5b-872c-299c3a297422 service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28b72315-fb91-41a5-b311-459c423778d0 req-d32dba64-1143-4d5b-872c-299c3a297422 service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-28b72315-fb91-41a5-b311-459c423778d0 req-d32dba64-1143-4d5b-872c-299c3a297422 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] No waiting events found dispatching network-vif-unplugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.compute.manager [req-28b72315-fb91-41a5-b311-459c423778d0 req-d32dba64-1143-4d5b-872c-299c3a297422 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-vif-unplugged-f4bd23c1-4598-438d-ae7a-650f886fa67b for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updated VIF entry in instance network info cache for port f4bd23c1-4598-438d-ae7a-650f886fa67b. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.network.neutron [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updating instance_info_cache with network_info: [{"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2ec6d561-966d-4973-b6e5-eaca43aa93fe req-c1ab4f60-656f-49f9-9933-8e94ab3c3693 service nova] Releasing lock "refresh_cache-18184908-3352-4fce-95f5-fdfef9ccbbac" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:13:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Instance destroyed successfully.
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'resources' on Instance uuid 18184908-3352-4fce-95f5-fdfef9ccbbac {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-232506540',display_name='tempest-TestStampPattern-server-232506540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-232506540',id=45,image_ref='1cc5af36-c5d1-4956-b3df-8f162596c3b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6R61bltWmFa4FN/tWsYq0yxOivPOQKTAZeSQ5dsXkeubEsA2nCFaQStvXLxjmWo+g7lDxjht2O1Ocr4vblBDS8eTt8LrHcMZl0qklvkcI+40/AmthHciFjuWJkDB4Dw==',key_name='tempest-TestStampPattern-738172330',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:10:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e4b60edd64426696234f2fdff0f4a1',ramdisk_id='',reservation_id='r-m83br0l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a15d285b-c295-4a79-abd5-d535155130f1',image_min_disk='1',image_min_ram='0',image_owner_id='d5e4b60edd64426696234f2fdff0f4a1',image_owner_project_name='tempest-TestStampPattern-1703985163',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1703985163-project-member',image_user_id='121e9739ffb740a3bfc065653a688438',owner_project_name='tempest-TestStampPattern-1703985163',owner_user_name='tempest-TestStampPattern-1703985163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:10:07Z,user_data=None,user_id='121e9739ffb740a3bfc065653a688438',uuid=18184908-3352-4fce-95f5-fdfef9ccbbac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converting VIF {"id": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "address": "fa:16:3e:9c:8a:61", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bd23c1-45", "ovs_interfaceid": "f4bd23c1-4598-438d-ae7a-650f886fa67b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG os_vif [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4bd23c1-45, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=564b0f7a-769b-4495-8267-783f17894ee8) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:04 user nova-compute[76870]: INFO os_vif [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:8a:61,bridge_name='br-int',has_traffic_filtering=True,id=f4bd23c1-4598-438d-ae7a-650f886fa67b,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bd23c1-45')
Oct 20 15:13:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Deleting instance files /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac_del
Oct 20 15:13:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Deletion of /opt/stack/data/nova/instances/18184908-3352-4fce-95f5-fdfef9ccbbac_del complete
Oct 20 15:13:04 user nova-compute[76870]: INFO nova.compute.manager [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 20 15:13:04 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:04 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:13:05 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Took 0.49 seconds to deallocate network for instance.
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:05 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Deleted allocations for instance 18184908-3352-4fce-95f5-fdfef9ccbbac
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-8e007fda-0ee6-4955-957a-d7e1445d7b9e tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:13:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] Acquiring lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] Lock "18184908-3352-4fce-95f5-fdfef9ccbbac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] No waiting events found dispatching network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:13:06 user nova-compute[76870]: WARNING nova.compute.manager [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received unexpected event network-vif-plugged-f4bd23c1-4598-438d-ae7a-650f886fa67b for instance with vm_state deleted and task_state None.
Oct 20 15:13:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-24aafbb3-f967-48fa-820b-1fb67add96c5 req-9d9d9708-a5f5-4b0e-af61-35b883381ca6 service nova] [instance: 18184908-3352-4fce-95f5-fdfef9ccbbac] Received event network-vif-deleted-f4bd23c1-4598-438d-ae7a-650f886fa67b {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:13:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:13:09 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:13:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:13:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:13:11 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=24.796356201171875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:13:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:13:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:13:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:13:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:13:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:13:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:13:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:13:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:13:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:13:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:13:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:41 user nova-compute[76870]: INFO nova.compute.manager [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Unrescuing
Oct 20 15:13:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:13:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:13:41 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'flavor' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-bed1a050-eade-42cd-9f7c-3a6bbcb003ab req-2127311d-a6a3-4bff-8393-7af3ede40a5d service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bed1a050-eade-42cd-9f7c-3a6bbcb003ab req-2127311d-a6a3-4bff-8393-7af3ede40a5d service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bed1a050-eade-42cd-9f7c-3a6bbcb003ab req-2127311d-a6a3-4bff-8393-7af3ede40a5d service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bed1a050-eade-42cd-9f7c-3a6bbcb003ab req-2127311d-a6a3-4bff-8393-7af3ede40a5d service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG nova.compute.manager [req-bed1a050-eade-42cd-9f7c-3a6bbcb003ab req-2127311d-a6a3-4bff-8393-7af3ede40a5d service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:13:42 user nova-compute[76870]: WARNING nova.compute.manager [req-bed1a050-eade-42cd-9f7c-3a6bbcb003ab req-2127311d-a6a3-4bff-8393-7af3ede40a5d service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:13:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:43 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance destroyed successfully.
Oct 20 15:13:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:13:44 user nova-compute[76870]: WARNING nova.compute.manager [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:13:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:44 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:13:44 user nova-compute[76870]: WARNING nova.compute.manager [req-d1e62e15-de59-42a5-9ab7-692bdd725d9e req-6eb97177-4595-4726-ba00-46c8b66aaed5 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:13:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3d68256d-641c-4fb8-9c85-dfb137482ad2 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:13:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-6afa5879-99c9-4387-ac0d-15377b1d28fa req-c38aff19-2acc-460e-b2c8-b9428080218d service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:13:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6afa5879-99c9-4387-ac0d-15377b1d28fa req-c38aff19-2acc-460e-b2c8-b9428080218d service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:13:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6afa5879-99c9-4387-ac0d-15377b1d28fa req-c38aff19-2acc-460e-b2c8-b9428080218d service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:13:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-6afa5879-99c9-4387-ac0d-15377b1d28fa req-c38aff19-2acc-460e-b2c8-b9428080218d service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:13:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-6afa5879-99c9-4387-ac0d-15377b1d28fa req-c38aff19-2acc-460e-b2c8-b9428080218d service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:13:46 user nova-compute[76870]: WARNING nova.compute.manager [req-6afa5879-99c9-4387-ac0d-15377b1d28fa req-c38aff19-2acc-460e-b2c8-b9428080218d service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state active and task_state None.
Oct 20 15:13:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:13:58 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:13:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:14:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:14:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:14:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:14:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:14:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:14:07 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:14:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:14:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:14:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:14:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:14:12 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:14:12 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=24.89394760131836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance a15d285b-c295-4a79-abd5-d535155130f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:14:12 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-changed-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Refreshing instance network info cache due to event network-changed-ba4801b4-d24c-4e79-a59f-6c9d6f715160. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] Acquiring lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] Acquired lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Refreshing network info cache for port ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:13 user nova-compute[76870]: INFO nova.compute.manager [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Terminating instance
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-d34ec943-b48c-45af-a132-65e756671891 req-32036f37-fc5b-4247-871d-fdb4a50ac4b4 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-vif-unplugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d34ec943-b48c-45af-a132-65e756671891 req-32036f37-fc5b-4247-871d-fdb4a50ac4b4 service nova] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d34ec943-b48c-45af-a132-65e756671891 req-32036f37-fc5b-4247-871d-fdb4a50ac4b4 service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d34ec943-b48c-45af-a132-65e756671891 req-32036f37-fc5b-4247-871d-fdb4a50ac4b4 service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-d34ec943-b48c-45af-a132-65e756671891 req-32036f37-fc5b-4247-871d-fdb4a50ac4b4 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] No waiting events found dispatching network-vif-unplugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-d34ec943-b48c-45af-a132-65e756671891 req-32036f37-fc5b-4247-871d-fdb4a50ac4b4 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-vif-unplugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updated VIF entry in instance network info cache for port ba4801b4-d24c-4e79-a59f-6c9d6f715160. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.network.neutron [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [{"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2355ec83-d507-47e2-9fb3-db29a31f6a81 req-d9c69576-0a6e-4a74-90a4-bc17f9b2cdd2 service nova] Releasing lock "refresh_cache-a15d285b-c295-4a79-abd5-d535155130f1" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:14:13 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Instance destroyed successfully.
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lazy-loading 'resources' on Instance uuid a15d285b-c295-4a79-abd5-d535155130f1 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1782535738',display_name='tempest-TestStampPattern-server-1782535738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1782535738',id=42,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6R61bltWmFa4FN/tWsYq0yxOivPOQKTAZeSQ5dsXkeubEsA2nCFaQStvXLxjmWo+g7lDxjht2O1Ocr4vblBDS8eTt8LrHcMZl0qklvkcI+40/AmthHciFjuWJkDB4Dw==',key_name='tempest-TestStampPattern-738172330',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e4b60edd64426696234f2fdff0f4a1',ramdisk_id='',reservation_id='r-x4h13etf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1703985163',owner_user_name='tempest-TestStampPattern-1703985163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:09:57Z,user_data=None,user_id='121e9739ffb740a3bfc065653a688438',uuid=a15d285b-c295-4a79-abd5-d535155130f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converting VIF {"id": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "address": "fa:16:3e:5a:9f:32", "network": {"id": "58b2786a-26fe-4883-b002-dc31872518c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1032573341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e4b60edd64426696234f2fdff0f4a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4801b4-d2", "ovs_interfaceid": "ba4801b4-d24c-4e79-a59f-6c9d6f715160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG os_vif [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4801b4-d2, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23776f15-fea0-4d71-bf37-6bb1c69c35ba) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:14:13 user nova-compute[76870]: INFO os_vif [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:9f:32,bridge_name='br-int',has_traffic_filtering=True,id=ba4801b4-d24c-4e79-a59f-6c9d6f715160,network=Network(58b2786a-26fe-4883-b002-dc31872518c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4801b4-d2')
Oct 20 15:14:13 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Deleting instance files /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1_del
Oct 20 15:14:13 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Deletion of /opt/stack/data/nova/instances/a15d285b-c295-4a79-abd5-d535155130f1_del complete
Oct 20 15:14:14 user nova-compute[76870]: INFO nova.compute.manager [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 15:14:14 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:14:14 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:14:14 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a15d285b-c295-4a79-abd5-d535155130f1] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:14:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:14 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:14:14 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Took 0.86 seconds to deallocate network for instance.
Oct 20 15:14:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:15 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Deleted allocations for instance a15d285b-c295-4a79-abd5-d535155130f1
Oct 20 15:14:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-24ff84c2-bb74-4284-ae29-38101b8bbe0d tempest-TestStampPattern-1703985163 tempest-TestStampPattern-1703985163-project-member] Lock "a15d285b-c295-4a79-abd5-d535155130f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] Acquiring lock "a15d285b-c295-4a79-abd5-d535155130f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] Lock "a15d285b-c295-4a79-abd5-d535155130f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:14:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] No waiting events found dispatching network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:14:15 user nova-compute[76870]: WARNING nova.compute.manager [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received unexpected event network-vif-plugged-ba4801b4-d24c-4e79-a59f-6c9d6f715160 for instance with vm_state deleted and task_state None.
Oct 20 15:14:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-d8502465-7783-41ce-8487-224cf28efa02 req-34bbf74f-b29c-4252-9d1a-9bd9cd7b6451 service nova] [instance: a15d285b-c295-4a79-abd5-d535155130f1] Received event network-vif-deleted-ba4801b4-d24c-4e79-a59f-6c9d6f715160 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:14:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:14:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:14:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:14:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:14:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:15:00 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:02 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:15:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:08 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:15:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:15:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:15:08 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:15:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:15:09 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:15:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:15:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:15:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:15:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:15:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=24.92074966430664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:15:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:15:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "457c0e79-06f4-4411-b1cc-200e9275d114" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:15:34 user nova-compute[76870]: INFO nova.compute.claims [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Claim successful on node user
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:15:34 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:15:34 user nova-compute[76870]: DEBUG nova.policy [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3271422bfb4145dbad9e30dc8799aeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f01dd35514c0d98db23904e4ad1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:15:35 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Creating image(s)
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "/opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk 1073741824" returned: 0 in 0.059s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Successfully created port: 88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Cannot resize image /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Ensure instance console log exists: /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Successfully updated port: 88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-changed-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.compute.manager [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Refreshing instance network info cache due to event network-changed-88682581-9736-40dc-86d6-001abcd82dd4. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] Acquiring lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updating instance_info_cache with network_info: [{"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Instance network_info: |[{"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] Acquired lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.neutron [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Refreshing network info cache for port 88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Start _get_guest_xml network_info=[{"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:15:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:15:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-124391435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-124391435',id=47,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-fkb1vgin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:15:35Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=457c0e79-06f4-4411-b1cc-200e9275d114,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'pci_devices' on Instance uuid 457c0e79-06f4-4411-b1cc-200e9275d114 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:15:36 user nova-compute[76870]:   <uuid>457c0e79-06f4-4411-b1cc-200e9275d114</uuid>
Oct 20 15:15:36 user nova-compute[76870]:   <name>instance-0000002f</name>
Oct 20 15:15:36 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:15:36 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:15:36 user nova-compute[76870]:   <metadata>
Oct 20 15:15:36 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:15:36 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:15:36 user nova-compute[76870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-124391435</nova:name>
Oct 20 15:15:36 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:15:36</nova:creationTime>
Oct 20 15:15:36 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:15:36 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:15:36 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:15:36 user nova-compute[76870]:       <nova:owner>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:user uuid="3271422bfb4145dbad9e30dc8799aeb6">tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member</nova:user>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:project uuid="335f01dd35514c0d98db23904e4ad1d3">tempest-ServerBootFromVolumeStableRescueTest-1789045836</nova:project>
Oct 20 15:15:36 user nova-compute[76870]:       </nova:owner>
Oct 20 15:15:36 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:15:36 user nova-compute[76870]:       <nova:ports>
Oct 20 15:15:36 user nova-compute[76870]:         <nova:port uuid="88682581-9736-40dc-86d6-001abcd82dd4">
Oct 20 15:15:36 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 15:15:36 user nova-compute[76870]:         </nova:port>
Oct 20 15:15:36 user nova-compute[76870]:       </nova:ports>
Oct 20 15:15:36 user nova-compute[76870]:     </nova:instance>
Oct 20 15:15:36 user nova-compute[76870]:   </metadata>
Oct 20 15:15:36 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:15:36 user nova-compute[76870]:     <system>
Oct 20 15:15:36 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:15:36 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:15:36 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:15:36 user nova-compute[76870]:       <entry name="serial">457c0e79-06f4-4411-b1cc-200e9275d114</entry>
Oct 20 15:15:36 user nova-compute[76870]:       <entry name="uuid">457c0e79-06f4-4411-b1cc-200e9275d114</entry>
Oct 20 15:15:36 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:15:36 user nova-compute[76870]:     </system>
Oct 20 15:15:36 user nova-compute[76870]:   </sysinfo>
Oct 20 15:15:36 user nova-compute[76870]:   <os>
Oct 20 15:15:36 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:15:36 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:15:36 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:15:36 user nova-compute[76870]:   </os>
Oct 20 15:15:36 user nova-compute[76870]:   <features>
Oct 20 15:15:36 user nova-compute[76870]:     <acpi/>
Oct 20 15:15:36 user nova-compute[76870]:     <apic/>
Oct 20 15:15:36 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:15:36 user nova-compute[76870]:   </features>
Oct 20 15:15:36 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:15:36 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:15:36 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:15:36 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:15:36 user nova-compute[76870]:   </clock>
Oct 20 15:15:36 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:15:36 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:15:36 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:15:36 user nova-compute[76870]:   </cpu>
Oct 20 15:15:36 user nova-compute[76870]:   <devices>
Oct 20 15:15:36 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:15:36 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:15:36 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk"/>
Oct 20 15:15:36 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:15:36 user nova-compute[76870]:     </disk>
Oct 20 15:15:36 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:15:36 user nova-compute[76870]:       <mac address="fa:16:3e:b9:4f:20"/>
Oct 20 15:15:36 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:15:36 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:15:36 user nova-compute[76870]:       <target dev="tap88682581-97"/>
Oct 20 15:15:36 user nova-compute[76870]:     </interface>
Oct 20 15:15:36 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:15:36 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/console.log" append="off"/>
Oct 20 15:15:36 user nova-compute[76870]:     </serial>
Oct 20 15:15:36 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:15:36 user nova-compute[76870]:     <video>
Oct 20 15:15:36 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:15:36 user nova-compute[76870]:     </video>
Oct 20 15:15:36 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:15:36 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:15:36 user nova-compute[76870]:     </rng>
Oct 20 15:15:36 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:15:36 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:15:36 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:15:36 user nova-compute[76870]:     </memballoon>
Oct 20 15:15:36 user nova-compute[76870]:   </devices>
Oct 20 15:15:36 user nova-compute[76870]: </domain>
Oct 20 15:15:36 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-124391435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-124391435',id=47,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-fkb1vgin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:15:35Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=457c0e79-06f4-4411-b1cc-200e9275d114,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG os_vif [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79163ebf-5e95-53a7-9667-dad9796b032a', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88682581-97, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88682581-97, col_values=(('qos', UUID('371be233-ebfa-4f75-a44a-ab717f95cb85')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88682581-97, col_values=(('external_ids', {'iface-id': '88682581-9736-40dc-86d6-001abcd82dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:4f:20', 'vm-uuid': '457c0e79-06f4-4411-b1cc-200e9275d114'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:36 user nova-compute[76870]: INFO os_vif [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97')
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:15:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No VIF found with MAC fa:16:3e:b9:4f:20, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:15:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updated VIF entry in instance network info cache for port 88682581-9736-40dc-86d6-001abcd82dd4. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:15:37 user nova-compute[76870]: DEBUG nova.network.neutron [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updating instance_info_cache with network_info: [{"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:15:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-0d292659-d904-4fb1-83d0-bc8dd0af75eb req-a7921bd1-4e9e-413e-b7dd-2ec9ca1788b3 service nova] Releasing lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG nova.compute.manager [req-70cb1ad4-aafc-4180-b69b-5cc6b4292019 req-6d8e348e-63b9-4f0c-bc83-643ad88c06e6 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-70cb1ad4-aafc-4180-b69b-5cc6b4292019 req-6d8e348e-63b9-4f0c-bc83-643ad88c06e6 service nova] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-70cb1ad4-aafc-4180-b69b-5cc6b4292019 req-6d8e348e-63b9-4f0c-bc83-643ad88c06e6 service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-70cb1ad4-aafc-4180-b69b-5cc6b4292019 req-6d8e348e-63b9-4f0c-bc83-643ad88c06e6 service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG nova.compute.manager [req-70cb1ad4-aafc-4180-b69b-5cc6b4292019 req-6d8e348e-63b9-4f0c-bc83-643ad88c06e6 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] No waiting events found dispatching network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:15:38 user nova-compute[76870]: WARNING nova.compute.manager [req-70cb1ad4-aafc-4180-b69b-5cc6b4292019 req-6d8e348e-63b9-4f0c-bc83-643ad88c06e6 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received unexpected event network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 for instance with vm_state building and task_state spawning.
Oct 20 15:15:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:15:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Instance spawned successfully.
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:15:40 user nova-compute[76870]: INFO nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a17a669-6d01-4154-aff6-e911554f1bd2 req-10c692dd-a952-4b2b-aa96-1bcc19d9a9df service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a17a669-6d01-4154-aff6-e911554f1bd2 req-10c692dd-a952-4b2b-aa96-1bcc19d9a9df service nova] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a17a669-6d01-4154-aff6-e911554f1bd2 req-10c692dd-a952-4b2b-aa96-1bcc19d9a9df service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8a17a669-6d01-4154-aff6-e911554f1bd2 req-10c692dd-a952-4b2b-aa96-1bcc19d9a9df service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-8a17a669-6d01-4154-aff6-e911554f1bd2 req-10c692dd-a952-4b2b-aa96-1bcc19d9a9df service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] No waiting events found dispatching network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:15:40 user nova-compute[76870]: WARNING nova.compute.manager [req-8a17a669-6d01-4154-aff6-e911554f1bd2 req-10c692dd-a952-4b2b-aa96-1bcc19d9a9df service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received unexpected event network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 for instance with vm_state building and task_state spawning.
Oct 20 15:15:40 user nova-compute[76870]: INFO nova.compute.manager [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Took 6.07 seconds to build instance.
Oct 20 15:15:40 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b17ae641-ff86-4e90-ac57-a53731615efa tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "457c0e79-06f4-4411-b1cc-200e9275d114" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.158s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:15:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:15:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:02 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:03 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:16:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:07 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:16:10 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:16:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:16:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:16:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:16:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:16:13 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:16:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:16:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:16:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.882312774658203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:16:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:16:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:16:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:16:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:17:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:09 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:17:09 user nova-compute[76870]: INFO nova.compute.claims [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Claim successful on node user
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.policy [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '028ee7da03674a658749883af4ad3c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb268f2cefbf4d96b06187b7ce223848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:17:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:17:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Creating image(s)
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "/opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "/opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "/opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk 1073741824" returned: 0 in 0.055s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Successfully created port: b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Cannot resize image /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Ensure instance console log exists: /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Successfully updated port: b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquired lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-changed-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Refreshing instance network info cache due to event network-changed-b26352ce-aff3-4162-9b40-e215adc9ed64. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] Acquiring lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:17:11 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating instance_info_cache with network_info: [{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Releasing lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Instance network_info: |[{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] Acquired lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Refreshing network info cache for port b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Start _get_guest_xml network_info=[{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:17:12 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:17:12 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-76750828',display_name='tempest-SnapshotDataIntegrityTests-server-76750828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-76750828',id=48,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdbP8Zkeq7D+TDQGJes+WR2dxCAGTZ2ldbV3OYXTnsfb31JwWac47dBQKKI69Li4bF86xS2t9bOqWrfcRfS4ZNxJlCWY6UK1qUbMKKe0xhR2n0l15+SXaFMbjJXl0Z8Ag==',key_name='tempest-keypair-566455829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb268f2cefbf4d96b06187b7ce223848',ramdisk_id='',reservation_id='r-3y67o0yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1729309471',owner_user_name='tempest-SnapshotDataIntegrityTests-1729309471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='028ee7da03674a658749883af4ad3c47',uuid=40a3107c-65ee-4dda-bf8c-ffc7a68a073d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Converting VIF {"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'pci_devices' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:17:12 user nova-compute[76870]:   <uuid>40a3107c-65ee-4dda-bf8c-ffc7a68a073d</uuid>
Oct 20 15:17:12 user nova-compute[76870]:   <name>instance-00000030</name>
Oct 20 15:17:12 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:17:12 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:17:12 user nova-compute[76870]:   <metadata>
Oct 20 15:17:12 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:17:12 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:17:12 user nova-compute[76870]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-76750828</nova:name>
Oct 20 15:17:12 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:17:12</nova:creationTime>
Oct 20 15:17:12 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:17:12 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:17:12 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:17:12 user nova-compute[76870]:       <nova:owner>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:user uuid="028ee7da03674a658749883af4ad3c47">tempest-SnapshotDataIntegrityTests-1729309471-project-member</nova:user>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:project uuid="cb268f2cefbf4d96b06187b7ce223848">tempest-SnapshotDataIntegrityTests-1729309471</nova:project>
Oct 20 15:17:12 user nova-compute[76870]:       </nova:owner>
Oct 20 15:17:12 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:17:12 user nova-compute[76870]:       <nova:ports>
Oct 20 15:17:12 user nova-compute[76870]:         <nova:port uuid="b26352ce-aff3-4162-9b40-e215adc9ed64">
Oct 20 15:17:12 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 15:17:12 user nova-compute[76870]:         </nova:port>
Oct 20 15:17:12 user nova-compute[76870]:       </nova:ports>
Oct 20 15:17:12 user nova-compute[76870]:     </nova:instance>
Oct 20 15:17:12 user nova-compute[76870]:   </metadata>
Oct 20 15:17:12 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:17:12 user nova-compute[76870]:     <system>
Oct 20 15:17:12 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:17:12 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:17:12 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:17:12 user nova-compute[76870]:       <entry name="serial">40a3107c-65ee-4dda-bf8c-ffc7a68a073d</entry>
Oct 20 15:17:12 user nova-compute[76870]:       <entry name="uuid">40a3107c-65ee-4dda-bf8c-ffc7a68a073d</entry>
Oct 20 15:17:12 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:17:12 user nova-compute[76870]:     </system>
Oct 20 15:17:12 user nova-compute[76870]:   </sysinfo>
Oct 20 15:17:12 user nova-compute[76870]:   <os>
Oct 20 15:17:12 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:17:12 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:17:12 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:17:12 user nova-compute[76870]:   </os>
Oct 20 15:17:12 user nova-compute[76870]:   <features>
Oct 20 15:17:12 user nova-compute[76870]:     <acpi/>
Oct 20 15:17:12 user nova-compute[76870]:     <apic/>
Oct 20 15:17:12 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:17:12 user nova-compute[76870]:   </features>
Oct 20 15:17:12 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:17:12 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:17:12 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:17:12 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:17:12 user nova-compute[76870]:   </clock>
Oct 20 15:17:12 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:17:12 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:17:12 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:17:12 user nova-compute[76870]:   </cpu>
Oct 20 15:17:12 user nova-compute[76870]:   <devices>
Oct 20 15:17:12 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:17:12 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:17:12 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk"/>
Oct 20 15:17:12 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:17:12 user nova-compute[76870]:     </disk>
Oct 20 15:17:12 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:17:12 user nova-compute[76870]:       <mac address="fa:16:3e:d6:50:51"/>
Oct 20 15:17:12 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:17:12 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:17:12 user nova-compute[76870]:       <target dev="tapb26352ce-af"/>
Oct 20 15:17:12 user nova-compute[76870]:     </interface>
Oct 20 15:17:12 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:17:12 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/console.log" append="off"/>
Oct 20 15:17:12 user nova-compute[76870]:     </serial>
Oct 20 15:17:12 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:17:12 user nova-compute[76870]:     <video>
Oct 20 15:17:12 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:17:12 user nova-compute[76870]:     </video>
Oct 20 15:17:12 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:17:12 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:17:12 user nova-compute[76870]:     </rng>
Oct 20 15:17:12 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:17:12 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:17:12 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:17:12 user nova-compute[76870]:     </memballoon>
Oct 20 15:17:12 user nova-compute[76870]:   </devices>
Oct 20 15:17:12 user nova-compute[76870]: </domain>
Oct 20 15:17:12 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-76750828',display_name='tempest-SnapshotDataIntegrityTests-server-76750828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-76750828',id=48,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdbP8Zkeq7D+TDQGJes+WR2dxCAGTZ2ldbV3OYXTnsfb31JwWac47dBQKKI69Li4bF86xS2t9bOqWrfcRfS4ZNxJlCWY6UK1qUbMKKe0xhR2n0l15+SXaFMbjJXl0Z8Ag==',key_name='tempest-keypair-566455829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb268f2cefbf4d96b06187b7ce223848',ramdisk_id='',reservation_id='r-3y67o0yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1729309471',owner_user_name='tempest-SnapshotDataIntegrityTests-1729309471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='028ee7da03674a658749883af4ad3c47',uuid=40a3107c-65ee-4dda-bf8c-ffc7a68a073d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Converting VIF {"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG os_vif [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bb268f5-564b-5613-8790-a9a80cc23d1c', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb26352ce-af, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb26352ce-af, col_values=(('qos', UUID('31f7440b-9a59-4962-8197-656ab06e5b9a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb26352ce-af, col_values=(('external_ids', {'iface-id': 'b26352ce-aff3-4162-9b40-e215adc9ed64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:50:51', 'vm-uuid': '40a3107c-65ee-4dda-bf8c-ffc7a68a073d'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:12 user nova-compute[76870]: INFO os_vif [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af')
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No VIF found with MAC fa:16:3e:d6:50:51, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updated VIF entry in instance network info cache for port b26352ce-aff3-4162-9b40-e215adc9ed64. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG nova.network.neutron [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating instance_info_cache with network_info: [{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d63c8d51-8daf-4061-91f6-83e9126ccec7 req-24679e6c-6bb0-42ee-9966-2f068fa46d8a service nova] Releasing lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:17:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-2a993a2d-5156-406c-b0cf-6263bd1ae1c6 req-2ac5d735-f408-4f71-9333-ee497f405123 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2a993a2d-5156-406c-b0cf-6263bd1ae1c6 req-2ac5d735-f408-4f71-9333-ee497f405123 service nova] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2a993a2d-5156-406c-b0cf-6263bd1ae1c6 req-2ac5d735-f408-4f71-9333-ee497f405123 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2a993a2d-5156-406c-b0cf-6263bd1ae1c6 req-2ac5d735-f408-4f71-9333-ee497f405123 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.manager [req-2a993a2d-5156-406c-b0cf-6263bd1ae1c6 req-2ac5d735-f408-4f71-9333-ee497f405123 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] No waiting events found dispatching network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:17:13 user nova-compute[76870]: WARNING nova.compute.manager [req-2a993a2d-5156-406c-b0cf-6263bd1ae1c6 req-2ac5d735-f408-4f71-9333-ee497f405123 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received unexpected event network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 for instance with vm_state building and task_state spawning.
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 457c0e79-06f4-4411-b1cc-200e9275d114 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "457c0e79-06f4-4411-b1cc-200e9275d114" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "457c0e79-06f4-4411-b1cc-200e9275d114" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:13 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:15 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:17:15 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.879566192626953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:17:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Instance spawned successfully.
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-ed42a6a9-0938-40a9-a486-91b2982681c9 req-db4a156b-ec97-4be1-85f8-3d44fcf10f69 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ed42a6a9-0938-40a9-a486-91b2982681c9 req-db4a156b-ec97-4be1-85f8-3d44fcf10f69 service nova] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ed42a6a9-0938-40a9-a486-91b2982681c9 req-db4a156b-ec97-4be1-85f8-3d44fcf10f69 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ed42a6a9-0938-40a9-a486-91b2982681c9 req-db4a156b-ec97-4be1-85f8-3d44fcf10f69 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.manager [req-ed42a6a9-0938-40a9-a486-91b2982681c9 req-db4a156b-ec97-4be1-85f8-3d44fcf10f69 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] No waiting events found dispatching network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:17:15 user nova-compute[76870]: WARNING nova.compute.manager [req-ed42a6a9-0938-40a9-a486-91b2982681c9 req-db4a156b-ec97-4be1-85f8-3d44fcf10f69 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received unexpected event network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 for instance with vm_state building and task_state spawning.
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:17:15 user nova-compute[76870]: INFO nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:17:15 user nova-compute[76870]: INFO nova.compute.manager [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Took 6.07 seconds to build instance.
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ac28f64a-ac74-4cda-bcf7-2558261353c3 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.174s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.973s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:17:15 user nova-compute[76870]: INFO nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:17:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:17:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:17:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:17:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:17:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:17:25 user nova-compute[76870]: INFO nova.compute.manager [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] instance snapshotting
Oct 20 15:17:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Beginning live snapshot process
Oct 20 15:17:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json -f qcow2 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1t19gnc1/69f9be9a38b34003b8f84737cda7367d.delta 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1t19gnc1/69f9be9a38b34003b8f84737cda7367d.delta 1073741824" returned: 0 in 0.047s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:26 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 15:17:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76870) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 15:17:27 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 15:17:27 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 15:17:27 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1t19gnc1/69f9be9a38b34003b8f84737cda7367d.delta /opt/stack/data/nova/instances/snapshots/tmp1t19gnc1/69f9be9a38b34003b8f84737cda7367d {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:17:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1t19gnc1/69f9be9a38b34003b8f84737cda7367d.delta /opt/stack/data/nova/instances/snapshots/tmp1t19gnc1/69f9be9a38b34003b8f84737cda7367d" returned: 0 in 0.527s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:17:28 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Snapshot extracted, beginning image upload
Oct 20 15:17:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:30 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Snapshot image upload complete
Oct 20 15:17:30 user nova-compute[76870]: INFO nova.compute.manager [None req-d8787c81-06cb-4f19-83e2-f341e253f95b tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Took 5.03 seconds to snapshot the instance on the hypervisor.
Oct 20 15:17:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:17:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:17:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:17:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:18:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:18:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:18:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:18:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:18:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:18:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:18:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:18:13 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updating instance_info_cache with network_info: [{"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:16 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:18:16 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=24.80179214477539GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:18:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:18:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:18:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:18:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "106b927c-992c-4bc2-8471-96d252a290ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:18:32 user nova-compute[76870]: INFO nova.compute.claims [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Claim successful on node user
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.policy [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3271422bfb4145dbad9e30dc8799aeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f01dd35514c0d98db23904e4ad1d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:18:32 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:18:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:18:32 user nova-compute[76870]: INFO nova.virt.block_device [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Booting with volume-backed-image fe361d9c-2878-4d9c-9fb8-7c063759e6e5 at /dev/vda
Oct 20 15:18:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:33 user nova-compute[76870]: DEBUG nova.network.neutron [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Successfully created port: 3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:18:33 user nova-compute[76870]: DEBUG nova.network.neutron [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Successfully updated port: 3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:18:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:18:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:18:33 user nova-compute[76870]: DEBUG nova.network.neutron [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.network.neutron [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-changed-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Refreshing instance network info cache due to event network-changed-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] Acquiring lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.network.neutron [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updating instance_info_cache with network_info: [{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance network_info: |[{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] Acquired lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.network.neutron [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Refreshing network info cache for port 3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.network.neutron [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updated VIF entry in instance network info cache for port 3bfe660d-18ff-4cb2-8b69-dfd8d725d91c. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG nova.network.neutron [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updating instance_info_cache with network_info: [{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:18:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28011fef-c9a1-4450-9d52-37d3d24db160 req-8bb6462d-7544-4bf7-9b15-46ee4ec69f06 service nova] Releasing lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:18:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG os_brick.utils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80f053d-afae-4247-b7df-73b6152cd5a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d611f50-6402-47b9-a7cc-2ed9b34af1c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bdfea0-ba91-4be4-8d99-7ed9e677237a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9098ebf-77ef-40e4-a55e-bfb74502040f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:18:48 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:18:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ae990-42f2-4869-9d14-9d306bdb3e13]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG os_brick.utils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:18:48 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updating existing volume attachment record: 505d523f-da81-43bf-bb87-6fa6b539a398 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:18:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:18:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-changed-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:19:00 user nova-compute[76870]: DEBUG nova.compute.manager [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Refreshing instance network info cache due to event network-changed-b26352ce-aff3-4162-9b40-e215adc9ed64. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:19:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] Acquiring lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:19:00 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] Acquired lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:19:00 user nova-compute[76870]: DEBUG nova.network.neutron [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Refreshing network info cache for port b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:19:01 user nova-compute[76870]: DEBUG nova.network.neutron [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updated VIF entry in instance network info cache for port b26352ce-aff3-4162-9b40-e215adc9ed64. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:19:01 user nova-compute[76870]: DEBUG nova.network.neutron [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating instance_info_cache with network_info: [{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:19:01 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7a8cd770-f67d-4668-bcfe-f1a276b19bda req-556160cf-f5c1-4ba5-9791-4acbd4736db5 service nova] Releasing lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:19:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:19:03 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:06 user nova-compute[76870]: INFO nova.compute.manager [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attaching volume 1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 to /dev/vdb
Oct 20 15:19:06 user nova-compute[76870]: DEBUG os_brick.utils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f05647b-1379-48d2-8e25-e816f9331898]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d1129-eff3-4dff-9b12-a957f62ce64c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d214eb7-174c-49c2-84b1-1378aca10e9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1861d-5234-4a83-bb38-7266a76cd1b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:19:06 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:19:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ed291b-97ed-4424-9026-912ab895ec05]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:19:06 user nova-compute[76870]: DEBUG os_brick.utils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:19:07 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating existing volume attachment record: 64eb8b2d-1197-4cbf-8ce6-3e5f929bb453 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:19:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:07 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:08 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:19:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:19:14 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Creating image(s)
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Ensure instance console log exists: /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Start _get_guest_xml network_info=[{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '505d523f-da81-43bf-bb87-6fa6b539a398', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '106b927c-992c-4bc2-8471-96d252a290ce', 'attached_at': '', 'detached_at': '', 'volume_id': '998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'serial': '998986ca-d4e8-4a97-bdd3-d049a1e8bdf7'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:19:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:19:14 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:19:14 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:19:14 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:19:14 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddc99e5-c230-46c0-a7f1-7c32fd235c3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:19:14 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea5620-d2a1-4870-9a72-21dfcf00d763]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7] added
Oct 20 15:19:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a5a32-d5c3-47e1-b75d-790181e8053e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbb5eb-ffca-4def-9b91-89cd41aa6308]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtvbgzPB {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtvbgzPB" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee427abd-ce8b-49ce-97d2-76b795f08e0b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtvbgzPB'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb57be3-6fd2-4036-92e6-283369c8d185]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[339e39c5-dfd2-4acb-a396-23b915782957]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755837f-e681-42b7-a45a-fe10fcdcb502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260]
Oct 20 15:19:14 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260] successful.
Oct 20 15:19:14 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[661f7181-9d8a-438e-8ed3-2803f3cfe2cc]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:14 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[715d8d8f-ceda-44e4-8e54-de11f0a01931]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:15 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:19:15 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:15 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:19:15 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8c5e80-ed6e-4684-a958-4b53e0382fbe]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Skipping network cache update for instance because it is Building. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:19:15 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23063313236636261', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313236636261', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1979408968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1979408968',id=49,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-wjyvea46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:18:33Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=106b927c-992c-4bc2-8471-96d252a290ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.objects.instance [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'pci_devices' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:19:16 user nova-compute[76870]:   <uuid>106b927c-992c-4bc2-8471-96d252a290ce</uuid>
Oct 20 15:19:16 user nova-compute[76870]:   <name>instance-00000031</name>
Oct 20 15:19:16 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:19:16 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:19:16 user nova-compute[76870]:   <metadata>
Oct 20 15:19:16 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:19:16 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:19:16 user nova-compute[76870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1979408968</nova:name>
Oct 20 15:19:16 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:19:14</nova:creationTime>
Oct 20 15:19:16 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:19:16 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:19:16 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:19:16 user nova-compute[76870]:       <nova:owner>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:user uuid="3271422bfb4145dbad9e30dc8799aeb6">tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member</nova:user>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:project uuid="335f01dd35514c0d98db23904e4ad1d3">tempest-ServerBootFromVolumeStableRescueTest-1789045836</nova:project>
Oct 20 15:19:16 user nova-compute[76870]:       </nova:owner>
Oct 20 15:19:16 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:19:16 user nova-compute[76870]:       <nova:ports>
Oct 20 15:19:16 user nova-compute[76870]:         <nova:port uuid="3bfe660d-18ff-4cb2-8b69-dfd8d725d91c">
Oct 20 15:19:16 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 15:19:16 user nova-compute[76870]:         </nova:port>
Oct 20 15:19:16 user nova-compute[76870]:       </nova:ports>
Oct 20 15:19:16 user nova-compute[76870]:     </nova:instance>
Oct 20 15:19:16 user nova-compute[76870]:   </metadata>
Oct 20 15:19:16 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:19:16 user nova-compute[76870]:     <system>
Oct 20 15:19:16 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:19:16 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:19:16 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:19:16 user nova-compute[76870]:       <entry name="serial">106b927c-992c-4bc2-8471-96d252a290ce</entry>
Oct 20 15:19:16 user nova-compute[76870]:       <entry name="uuid">106b927c-992c-4bc2-8471-96d252a290ce</entry>
Oct 20 15:19:16 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:19:16 user nova-compute[76870]:     </system>
Oct 20 15:19:16 user nova-compute[76870]:   </sysinfo>
Oct 20 15:19:16 user nova-compute[76870]:   <os>
Oct 20 15:19:16 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:19:16 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:19:16 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:19:16 user nova-compute[76870]:   </os>
Oct 20 15:19:16 user nova-compute[76870]:   <features>
Oct 20 15:19:16 user nova-compute[76870]:     <acpi/>
Oct 20 15:19:16 user nova-compute[76870]:     <apic/>
Oct 20 15:19:16 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:19:16 user nova-compute[76870]:   </features>
Oct 20 15:19:16 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:19:16 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:19:16 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:19:16 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:19:16 user nova-compute[76870]:   </clock>
Oct 20 15:19:16 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:19:16 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:19:16 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:19:16 user nova-compute[76870]:   </cpu>
Oct 20 15:19:16 user nova-compute[76870]:   <devices>
Oct 20 15:19:16 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:19:16 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:19:16 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 15:19:16 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:19:16 user nova-compute[76870]:       <serial>998986ca-d4e8-4a97-bdd3-d049a1e8bdf7</serial>
Oct 20 15:19:16 user nova-compute[76870]:     </disk>
Oct 20 15:19:16 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:19:16 user nova-compute[76870]:       <mac address="fa:16:3e:14:88:ae"/>
Oct 20 15:19:16 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:19:16 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:19:16 user nova-compute[76870]:       <target dev="tap3bfe660d-18"/>
Oct 20 15:19:16 user nova-compute[76870]:     </interface>
Oct 20 15:19:16 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:19:16 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/console.log" append="off"/>
Oct 20 15:19:16 user nova-compute[76870]:     </serial>
Oct 20 15:19:16 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:19:16 user nova-compute[76870]:     <video>
Oct 20 15:19:16 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:19:16 user nova-compute[76870]:     </video>
Oct 20 15:19:16 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:19:16 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:19:16 user nova-compute[76870]:     </rng>
Oct 20 15:19:16 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:19:16 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:19:16 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:19:16 user nova-compute[76870]:     </memballoon>
Oct 20 15:19:16 user nova-compute[76870]:   </devices>
Oct 20 15:19:16 user nova-compute[76870]: </domain>
Oct 20 15:19:16 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1979408968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1979408968',id=49,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-wjyvea46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:18:33Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=106b927c-992c-4bc2-8471-96d252a290ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG os_vif [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca6c4da8-7e7f-56ab-bbef-0c9f2baa9f3c', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bfe660d-18, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bfe660d-18, col_values=(('qos', UUID('e039991b-efd6-4f7e-ab55-48cd11fe3c25')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bfe660d-18, col_values=(('external_ids', {'iface-id': '3bfe660d-18ff-4cb2-8b69-dfd8d725d91c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:88:ae', 'vm-uuid': '106b927c-992c-4bc2-8471-96d252a290ce'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:16 user nova-compute[76870]: INFO os_vif [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18')
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No VIF found with MAC fa:16:3e:14:88:ae, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-f626e801-0c55-4e3f-89f7-3479d27c416e req-6eb29ae0-a587-44d9-a188-a804838c80a5 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f626e801-0c55-4e3f-89f7-3479d27c416e req-6eb29ae0-a587-44d9-a188-a804838c80a5 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f626e801-0c55-4e3f-89f7-3479d27c416e req-6eb29ae0-a587-44d9-a188-a804838c80a5 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-f626e801-0c55-4e3f-89f7-3479d27c416e req-6eb29ae0-a587-44d9-a188-a804838c80a5 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-f626e801-0c55-4e3f-89f7-3479d27c416e req-6eb29ae0-a587-44d9-a188-a804838c80a5 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:19:17 user nova-compute[76870]: WARNING nova.compute.manager [req-f626e801-0c55-4e3f-89f7-3479d27c416e req-6eb29ae0-a587-44d9-a188-a804838c80a5 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state building and task_state spawning.
Oct 20 15:19:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:19:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:19:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=24.80022430419922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 106b927c-992c-4bc2-8471-96d252a290ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:19:19 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance spawned successfully.
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:19:19 user nova-compute[76870]: INFO nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-e1609bab-d6df-4ff0-890b-1e0791ba532a req-6c125680-6f9a-4382-b2a3-71090e03c0a5 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e1609bab-d6df-4ff0-890b-1e0791ba532a req-6c125680-6f9a-4382-b2a3-71090e03c0a5 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e1609bab-d6df-4ff0-890b-1e0791ba532a req-6c125680-6f9a-4382-b2a3-71090e03c0a5 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e1609bab-d6df-4ff0-890b-1e0791ba532a req-6c125680-6f9a-4382-b2a3-71090e03c0a5 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-e1609bab-d6df-4ff0-890b-1e0791ba532a req-6c125680-6f9a-4382-b2a3-71090e03c0a5 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:19:19 user nova-compute[76870]: WARNING nova.compute.manager [req-e1609bab-d6df-4ff0-890b-1e0791ba532a req-6c125680-6f9a-4382-b2a3-71090e03c0a5 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state building and task_state spawning.
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:19 user nova-compute[76870]: INFO nova.compute.manager [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Took 47.60 seconds to build instance.
Oct 20 15:19:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-597155d5-5da4-4dcc-837d-3cd0c32e1117 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "106b927c-992c-4bc2-8471-96d252a290ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.705s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:23 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:19:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsgMhBmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:19:23 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:19:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:19:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:19:23 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:19:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:19:23 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:19:23 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:19:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c4c78-bf43-4470-a13f-698e35b808c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:19:24 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc0611-caef-49fd-91f1-3ad29d10266d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51] added
Oct 20 15:19:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9cdf95-4b01-409b-8232-50660d4101aa]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d474b0d9-5a8a-49b6-992f-d0ba0e95657a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JsgMhBmO {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JsgMhBmO" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a63b50-db38-470b-ad17-4241dd37f3bf]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JsgMhBmO'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5dee5-e966-4cf9-b08c-19db2b9934f3]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0a3b9-8ce5-4353-bbbe-cb7373374b94]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:24 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:19:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:24 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:19:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe7c8a-63bf-4953-ab4e-23c327589067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260]
Oct 20 15:19:24 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260] successful.
Oct 20 15:19:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[945922d5-4cab-47ee-9cb8-4b98f8180fd5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98bde7-4ca3-4262-8cc3-e986607c5dfc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:24 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:19:24 user nova-compute[76870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 (non-flash)
Oct 20 15:19:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:19:24 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:19:24 user nova-compute[76870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 (non-flash)
Oct 20 15:19:24 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd05ee-4a55-49e5-95c7-9d137ea65577]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsgMhBmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26330363365373733', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330363365373733', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG nova.objects.instance [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:19:25 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:19:25 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:19:25 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:19:25 user nova-compute[76870]:   <serial>1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51</serial>
Oct 20 15:19:25 user nova-compute[76870]: </disk>
Oct 20 15:19:25 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No VIF found with MAC fa:16:3e:d6:50:51, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:19:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-65c77e33-7783-4e84-a36b-a741e33ed1a4 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.130s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:19:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:19:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:19:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:19:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:19:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:19:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:19:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:19:58 user nova-compute[76870]: INFO nova.compute.manager [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Detaching volume 1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51
Oct 20 15:19:58 user nova-compute[76870]: INFO nova.virt.block_device [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attempting to driver detach volume 1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 from mountpoint /dev/vdb
Oct 20 15:19:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Attempting to detach device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:19:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:19:58 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:19:58 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:19:58 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:19:58 user nova-compute[76870]:   <serial>1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51</serial>
Oct 20 15:19:58 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:19:58 user nova-compute[76870]: </disk>
Oct 20 15:19:58 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:19:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config.
Oct 20 15:19:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:19:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:19:58 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:19:58 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:19:58 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:19:58 user nova-compute[76870]:   <serial>1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51</serial>
Oct 20 15:19:58 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:19:58 user nova-compute[76870]: </disk>
Oct 20 15:19:58 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:19:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:20:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:20:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:04 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:20:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:20:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:20:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:20:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:20:15 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:17 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:20:17 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:20:17 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=24.798385620117188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 106b927c-992c-4bc2-8471-96d252a290ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:18 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d is timed out.
Oct 20 15:20:18 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config.
Oct 20 15:20:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsgMhBmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:20:18 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9758dd72-13b2-4a87-9e9e-e2e811627ff8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:20:18 user nova-compute[76870]: No targets found.
Oct 20 15:20:18 user nova-compute[76870]: iSNS:
Oct 20 15:20:18 user nova-compute[76870]: No targets found.
Oct 20 15:20:18 user nova-compute[76870]: STATIC:
Oct 20 15:20:18 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51
Oct 20 15:20:18 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:20:18 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:20:18 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7
Oct 20 15:20:18 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:20:18 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:20:18 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:20:18 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:20:18 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:20:18 user nova-compute[76870]: FIRMWARE:
Oct 20 15:20:18 user nova-compute[76870]: No targets found.
Oct 20 15:20:18 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:20:18 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:20:18 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[153ce956-779b-4509-b8fb-6f3b9bc069bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[353c761f-afee-41e8-85e6-b5191595dde8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:20:18 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:20:18 user nova-compute[76870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 (non-flash)
Oct 20 15:20:18 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:20:18 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:20:18 user nova-compute[76870]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 (non-flash)
Oct 20 15:20:18 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf8489c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0b9ef-1479-4b02-a82b-067b10d9cfb0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[263709e6-6cb6-4c5d-a66f-6d60a48bad47]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adbe785-4ce9-4467-8ee3-7cc48fdd23c0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:20:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdc84b-c269-4be6-88cb-59d0ffbf7a33]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a479b0-ad38-4263-82ee-7de2c64ae534]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e3de6f-0f42-48c2-a34b-6393ec96c658]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260]
Oct 20 15:20:19 user nova-compute[76870]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51, portal: 172.16.0.220,3260] successful.
Oct 20 15:20:19 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba1c2c9-3724-40f4-8bc0-0b6ac48f0b51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[399501e2-a320-4209-88e4-453dd7a055f2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== disconnect_volume: return (280ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:20:19 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c5e4cbd8-b34b-4f00-90d9-6a2197c1ea3b tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.732s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:23 user nova-compute[76870]: INFO nova.compute.manager [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Rescuing
Oct 20 15:20:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updating instance_info_cache with network_info: [{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-85f9d610-0dcd-4604-8bd7-a3d17cde7121 req-1f0d5be7-688f-482e-9427-96477f1a9862 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-85f9d610-0dcd-4604-8bd7-a3d17cde7121 req-1f0d5be7-688f-482e-9427-96477f1a9862 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-85f9d610-0dcd-4604-8bd7-a3d17cde7121 req-1f0d5be7-688f-482e-9427-96477f1a9862 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-85f9d610-0dcd-4604-8bd7-a3d17cde7121 req-1f0d5be7-688f-482e-9427-96477f1a9862 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG nova.compute.manager [req-85f9d610-0dcd-4604-8bd7-a3d17cde7121 req-1f0d5be7-688f-482e-9427-96477f1a9862 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:20:24 user nova-compute[76870]: WARNING nova.compute.manager [req-85f9d610-0dcd-4604-8bd7-a3d17cde7121 req-1f0d5be7-688f-482e-9427-96477f1a9862 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state active and task_state rescuing.
Oct 20 15:20:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:24 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance destroyed successfully.
Oct 20 15:20:24 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Attempting a stable device rescue
Oct 20 15:20:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76870) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance directory exists: not creating {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 15:20:24 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Creating image(s)
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "/opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "/opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'trusted_certs' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "4d32cafc3fe9552d170273536bf4bdcc806f2223" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "4d32cafc3fe9552d170273536bf4bdcc806f2223" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.part --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.part --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:25 user nova-compute[76870]: DEBUG nova.virt.images [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] 147d6c2a-6ca4-478d-a648-0cfdcf8457f2 was qcow2, converting to raw {{(pid=76870) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 15:20:25 user nova-compute[76870]: DEBUG nova.privsep.utils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76870) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 15:20:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.part /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.converted {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.part /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.converted" returned: 0 in 0.356s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.converted --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1a8d3da-fed5-4819-9e6b-4ea90d9324b4 req-a540b859-31d2-41f8-b359-461976deadaa service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1a8d3da-fed5-4819-9e6b-4ea90d9324b4 req-a540b859-31d2-41f8-b359-461976deadaa service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1a8d3da-fed5-4819-9e6b-4ea90d9324b4 req-a540b859-31d2-41f8-b359-461976deadaa service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-d1a8d3da-fed5-4819-9e6b-4ea90d9324b4 req-a540b859-31d2-41f8-b359-461976deadaa service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.compute.manager [req-d1a8d3da-fed5-4819-9e6b-4ea90d9324b4 req-a540b859-31d2-41f8-b359-461976deadaa service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:20:26 user nova-compute[76870]: WARNING nova.compute.manager [req-d1a8d3da-fed5-4819-9e6b-4ea90d9324b4 req-a540b859-31d2-41f8-b359-461976deadaa service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state active and task_state rescuing.
Oct 20 15:20:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "4d32cafc3fe9552d170273536bf4bdcc806f2223" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.651s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "4d32cafc3fe9552d170273536bf4bdcc806f2223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "4d32cafc3fe9552d170273536bf4bdcc806f2223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223 --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223,backing_fmt=raw /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d32cafc3fe9552d170273536bf4bdcc806f2223,backing_fmt=raw /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue" returned: 0 in 0.049s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "4d32cafc3fe9552d170273536bf4bdcc806f2223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'migration_context' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<106b927c-992c-4bc2-8471-96d252a290ce> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Start _get_guest_xml network_info=[{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "vif_mac": "fa:16:3e:14:88:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '147d6c2a-6ca4-478d-a648-0cfdcf8457f2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '505d523f-da81-43bf-bb87-6fa6b539a398', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '106b927c-992c-4bc2-8471-96d252a290ce', 'attached_at': '', 'detached_at': '', 'volume_id': '998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'serial': '998986ca-d4e8-4a97-bdd3-d049a1e8bdf7'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'resources' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<106b927c-992c-4bc2-8471-96d252a290ce> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'numa_topology' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<106b927c-992c-4bc2-8471-96d252a290ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:20:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:20:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'vcpu_model' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<106b927c-992c-4bc2-8471-96d252a290ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:20:26 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:20:26 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:20:26 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[59315ecd-8d94-4fa4-8be5-30f2f77015b6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LtvbgzPB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 15:20:26 user nova-compute[76870]: node.name = iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7
Oct 20 15:20:26 user nova-compute[76870]: node.tpgt = -1
Oct 20 15:20:26 user nova-compute[76870]: node.startup = automatic
Oct 20 15:20:26 user nova-compute[76870]: node.leading_login = No
Oct 20 15:20:26 user nova-compute[76870]: iface.iscsi_ifacename = default
Oct 20 15:20:26 user nova-compute[76870]: iface.net_ifacename = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.ipaddress = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.prefix_len = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.hwaddress = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.transport_name = tcp
Oct 20 15:20:26 user nova-compute[76870]: iface.initiatorname = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.vlan_id = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.vlan_priority = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.vlan_state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.iface_num = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.mtu = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.port = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.bootproto = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.subnet_mask = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.gateway = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_alt_client_id = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_dns = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_learn_iqn = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_vendor_id_state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_vendor_id = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.dhcp_slp_da = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.fragmentation = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.gratuitous_arp = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.incoming_forwarding = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.tos_state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.tos = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.ttl = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.delayed_ack = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.tcp_nagle = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.tcp_wsf_state = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.tcp_wsf = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.tcp_timer_scale = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.tcp_timestamp = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.redirect = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.def_task_mgmt_timeout = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.header_digest = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.data_digest = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.immediate_data = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.initial_r2t = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.data_seq_inorder = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.data_pdu_inorder = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.erl = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.max_receive_data_len = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.first_burst_len = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.max_outstanding_r2t = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.max_burst_len = 0
Oct 20 15:20:26 user nova-compute[76870]: iface.chap_auth = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.bidi_chap = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.strict_login_compliance = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.discovery_auth = <empty>
Oct 20 15:20:26 user nova-compute[76870]: iface.discovery_logout = <empty>
Oct 20 15:20:26 user nova-compute[76870]: node.discovery_address = <empty>
Oct 20 15:20:26 user nova-compute[76870]: node.discovery_port = 0
Oct 20 15:20:26 user nova-compute[76870]: node.discovery_type = static
Oct 20 15:20:26 user nova-compute[76870]: node.session.initial_cmdsn = 0
Oct 20 15:20:26 user nova-compute[76870]: node.session.initial_login_retry_max = 8
Oct 20 15:20:26 user nova-compute[76870]: node.session.xmit_thread_priority = -20
Oct 20 15:20:26 user nova-compute[76870]: node.session.cmds_max = 128
Oct 20 15:20:26 user nova-compute[76870]: node.session.queue_depth = 32
Oct 20 15:20:26 user nova-compute[76870]: node.session.nr_sessions = 1
Oct 20 15:20:26 user nova-compute[76870]: node.session.auth.authmethod = CHAP
Oct 20 15:20:26 user nova-compute[76870]: node.session.auth.username = LtvbgzPB
Oct 20 15:20:26 user nova-compute[76870]: node.session.auth.password = ***
Oct 20 15:20:26 user nova-compute[76870]: node.session.auth.username_in = <empty>
Oct 20 15:20:26 user nova-compute[76870]: node.session.auth.password_in = <empty>
Oct 20 15:20:26 user nova-compute[76870]: node.session.auth.chap_algs = MD5
Oct 20 15:20:26 user nova-compute[76870]: node.session.timeo.replacement_timeout = 120
Oct 20 15:20:26 user nova-compute[76870]: node.session.err_timeo.abort_timeout = 15
Oct 20 15:20:26 user nova-compute[76870]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 15:20:26 user nova-compute[76870]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 15:20:26 user nova-compute[76870]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.FastAbort = Yes
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.InitialR2T = No
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.ImmediateData = Yes
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.MaxConnections = 1
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 15:20:26 user nova-compute[76870]: node.session.iscsi.ERL = 0
Oct 20 15:20:26 user nova-compute[76870]: node.session.scan = manual
Oct 20 15:20:26 user nova-compute[76870]: node.session.reopen_max = 0
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].address = 172.16.0.220
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].port = 3260
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].startup = manual
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].tcp.window_size = 524288
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].tcp.type_of_service = 0
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].timeo.logout_timeout = 15
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].timeo.login_timeout = 15
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].timeo.auth_timeout = 45
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].iscsi.DataDigest = None
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].iscsi.IFMarker = No
Oct 20 15:20:26 user nova-compute[76870]: node.conn[0].iscsi.OFMarker = No
Oct 20 15:20:26 user nova-compute[76870]: # END RECORD
Oct 20 15:20:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465785c-daf4-4828-8aec-c070c3f30ad5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb40eea8-6777-4a9d-bb23-33df19547037]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtvbgzPB {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtvbgzPB" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd784ff-a968-4ac6-9268-bbbb7882477f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtvbgzPB'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b32a0-08d2-4dc6-82fc-904c2925dbb1]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e18ee-9357-4858-bff9-d12316389293]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:20:26 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:20:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:20:26 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:20:26 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.123s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] HCTL ('33', '0', '0', 0) found on session 48 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1732e605-ad6f-4e8c-a6d7-74765692cfc8]: (4, ('0 0 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Searching for a device in session 48 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.145s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== connect_volume: return (147ms) {'type': 'block', 'scsi_wwn': '23063313236636261', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313236636261', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1979408968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1979408968',id=49,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:19:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-wjyvea46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:19:20Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=106b927c-992c-4bc2-8471-96d252a290ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "vif_mac": "fa:16:3e:14:88:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "vif_mac": "fa:16:3e:14:88:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.instance [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'pci_devices' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.objects.base [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Object Instance<106b927c-992c-4bc2-8471-96d252a290ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:20:26 user nova-compute[76870]:   <uuid>106b927c-992c-4bc2-8471-96d252a290ce</uuid>
Oct 20 15:20:26 user nova-compute[76870]:   <name>instance-00000031</name>
Oct 20 15:20:26 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:20:26 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:20:26 user nova-compute[76870]:   <metadata>
Oct 20 15:20:26 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:20:26 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:20:26 user nova-compute[76870]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1979408968</nova:name>
Oct 20 15:20:26 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:20:26</nova:creationTime>
Oct 20 15:20:26 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:20:26 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:20:26 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:20:26 user nova-compute[76870]:       <nova:owner>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:user uuid="3271422bfb4145dbad9e30dc8799aeb6">tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member</nova:user>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:project uuid="335f01dd35514c0d98db23904e4ad1d3">tempest-ServerBootFromVolumeStableRescueTest-1789045836</nova:project>
Oct 20 15:20:26 user nova-compute[76870]:       </nova:owner>
Oct 20 15:20:26 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:20:26 user nova-compute[76870]:       <nova:ports>
Oct 20 15:20:26 user nova-compute[76870]:         <nova:port uuid="3bfe660d-18ff-4cb2-8b69-dfd8d725d91c">
Oct 20 15:20:26 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 15:20:26 user nova-compute[76870]:         </nova:port>
Oct 20 15:20:26 user nova-compute[76870]:       </nova:ports>
Oct 20 15:20:26 user nova-compute[76870]:     </nova:instance>
Oct 20 15:20:26 user nova-compute[76870]:   </metadata>
Oct 20 15:20:26 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:20:26 user nova-compute[76870]:     <system>
Oct 20 15:20:26 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:20:26 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:20:26 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:20:26 user nova-compute[76870]:       <entry name="serial">106b927c-992c-4bc2-8471-96d252a290ce</entry>
Oct 20 15:20:26 user nova-compute[76870]:       <entry name="uuid">106b927c-992c-4bc2-8471-96d252a290ce</entry>
Oct 20 15:20:26 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:20:26 user nova-compute[76870]:     </system>
Oct 20 15:20:26 user nova-compute[76870]:   </sysinfo>
Oct 20 15:20:26 user nova-compute[76870]:   <os>
Oct 20 15:20:26 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:20:26 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:20:26 user nova-compute[76870]:   </os>
Oct 20 15:20:26 user nova-compute[76870]:   <features>
Oct 20 15:20:26 user nova-compute[76870]:     <acpi/>
Oct 20 15:20:26 user nova-compute[76870]:     <apic/>
Oct 20 15:20:26 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:20:26 user nova-compute[76870]:   </features>
Oct 20 15:20:26 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:20:26 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:20:26 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:20:26 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:20:26 user nova-compute[76870]:   </clock>
Oct 20 15:20:26 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:20:26 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:20:26 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:20:26 user nova-compute[76870]:   </cpu>
Oct 20 15:20:26 user nova-compute[76870]:   <devices>
Oct 20 15:20:26 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:20:26 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:20:26 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 15:20:26 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:20:26 user nova-compute[76870]:       <serial>998986ca-d4e8-4a97-bdd3-d049a1e8bdf7</serial>
Oct 20 15:20:26 user nova-compute[76870]:     </disk>
Oct 20 15:20:26 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:20:26 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:20:26 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue"/>
Oct 20 15:20:26 user nova-compute[76870]:       <target dev="vdb" bus="virtio"/>
Oct 20 15:20:26 user nova-compute[76870]:       <boot order="1"/>
Oct 20 15:20:26 user nova-compute[76870]:     </disk>
Oct 20 15:20:26 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:20:26 user nova-compute[76870]:       <mac address="fa:16:3e:14:88:ae"/>
Oct 20 15:20:26 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:20:26 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:20:26 user nova-compute[76870]:       <target dev="tap3bfe660d-18"/>
Oct 20 15:20:26 user nova-compute[76870]:     </interface>
Oct 20 15:20:26 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:20:26 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/console.log" append="off"/>
Oct 20 15:20:26 user nova-compute[76870]:     </serial>
Oct 20 15:20:26 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:20:26 user nova-compute[76870]:     <video>
Oct 20 15:20:26 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:20:26 user nova-compute[76870]:     </video>
Oct 20 15:20:26 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:20:26 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:20:26 user nova-compute[76870]:     </rng>
Oct 20 15:20:26 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:20:26 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:20:26 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:20:26 user nova-compute[76870]:     </memballoon>
Oct 20 15:20:26 user nova-compute[76870]:   </devices>
Oct 20 15:20:26 user nova-compute[76870]: </domain>
Oct 20 15:20:26 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:20:26 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance destroyed successfully.
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:20:26 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] No VIF found with MAC fa:16:3e:14:88:ae, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-9227d1b9-5035-4922-b85d-4bbd6082807b req-6439213e-c597-4928-9182-c0e1036a545b service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9227d1b9-5035-4922-b85d-4bbd6082807b req-6439213e-c597-4928-9182-c0e1036a545b service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9227d1b9-5035-4922-b85d-4bbd6082807b req-6439213e-c597-4928-9182-c0e1036a545b service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9227d1b9-5035-4922-b85d-4bbd6082807b req-6439213e-c597-4928-9182-c0e1036a545b service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:28 user nova-compute[76870]: DEBUG nova.compute.manager [req-9227d1b9-5035-4922-b85d-4bbd6082807b req-6439213e-c597-4928-9182-c0e1036a545b service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:20:28 user nova-compute[76870]: WARNING nova.compute.manager [req-9227d1b9-5035-4922-b85d-4bbd6082807b req-6439213e-c597-4928-9182-c0e1036a545b service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state active and task_state rescuing.
Oct 20 15:20:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-4d97e861-2639-4990-a2d3-7a26c633712a tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:20:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-206c0d5b-8d12-46a9-a53c-de0929149fc3 req-f839ea8d-9927-448f-96b1-10202936e785 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:20:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-206c0d5b-8d12-46a9-a53c-de0929149fc3 req-f839ea8d-9927-448f-96b1-10202936e785 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-206c0d5b-8d12-46a9-a53c-de0929149fc3 req-f839ea8d-9927-448f-96b1-10202936e785 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-206c0d5b-8d12-46a9-a53c-de0929149fc3 req-f839ea8d-9927-448f-96b1-10202936e785 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:30 user nova-compute[76870]: DEBUG nova.compute.manager [req-206c0d5b-8d12-46a9-a53c-de0929149fc3 req-f839ea8d-9927-448f-96b1-10202936e785 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:20:30 user nova-compute[76870]: WARNING nova.compute.manager [req-206c0d5b-8d12-46a9-a53c-de0929149fc3 req-f839ea8d-9927-448f-96b1-10202936e785 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state None.
Oct 20 15:20:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:20:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:20:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:20:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:20:54 user nova-compute[76870]: INFO nova.compute.manager [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attaching volume 986f5d32-e54d-42a6-b914-c60f786a84ea to /dev/vdb
Oct 20 15:20:54 user nova-compute[76870]: DEBUG os_brick.utils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2930d8c2-56f4-4f61-be4c-9942a7cf1515]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b4ed5-0410-4331-9e85-2055ca4f6d76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79b4086-4aa6-4362-9866-dd476995f0e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c22d2-86be-45a6-afac-a39b267007c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:20:55 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:20:55 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b0a873-f193-4d0b-8f4a-f24a2b705331]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG os_brick.utils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating existing volume attachment record: 9b2dfb1c-3aba-4e60-92f7-f58ef1851c67 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:20:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:20:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:06 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:09 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRKPsAHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:21:11 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:21:11 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:21:11 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[261b6546-49e2-4cc3-8fff-d8a4c148d9b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:21:11 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f172e4ab-3189-4ef7-90a9-400aaf3d0c5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea] added
Oct 20 15:21:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2c49c-b6db-425d-869f-e6b5839816c5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa385b9-56fd-4754-ac0b-9563c354e407]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRKPsAHf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRKPsAHf" returned: 0 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a58de62-eadb-46d8-b730-a4f09feebfad]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CRKPsAHf'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e731e6-857d-4b88-b4b0-027951721ba4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb068cd3-b705-42bc-a1b8-866bdfde8b75]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:21:11 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:21:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:21:11 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:21:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f741f83-dad0-4dbe-970d-ad566febffe4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260]
Oct 20 15:21:11 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260] successful.
Oct 20 15:21:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a234d7d2-b629-4fcd-bfb8-ae6549436155]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2acb5fe-30a7-44aa-a097-497d15e824a3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:21:11 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:21:11 user nova-compute[76870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea (non-flash)
Oct 20 15:21:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:21:11 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:21:11 user nova-compute[76870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea (non-flash)
Oct 20 15:21:11 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cc803e-1db3-4eaa-ab8d-24fca57af678]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:11 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:21:12 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:21:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRKPsAHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:21:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:21:12 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26362363262613735', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:21:12 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362363262613735', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:21:13 user nova-compute[76870]: DEBUG nova.objects.instance [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:21:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:21:13 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:21:13 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:21:13 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:21:13 user nova-compute[76870]:   <serial>986f5d32-e54d-42a6-b914-c60f786a84ea</serial>
Oct 20 15:21:13 user nova-compute[76870]: </disk>
Oct 20 15:21:13 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:21:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:21:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:21:13 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No VIF found with MAC fa:16:3e:d6:50:51, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:21:13 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-34ca3729-d0c6-427c-a013-43184ebcd6c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.769s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:21:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:21:15 user nova-compute[76870]: INFO nova.compute.manager [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Detaching volume 986f5d32-e54d-42a6-b914-c60f786a84ea
Oct 20 15:21:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:21:15 user nova-compute[76870]: INFO nova.virt.block_device [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attempting to driver detach volume 986f5d32-e54d-42a6-b914-c60f786a84ea from mountpoint /dev/vdb
Oct 20 15:21:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Attempting to detach device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:21:15 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:21:15 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:21:15 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:21:15 user nova-compute[76870]:   <serial>986f5d32-e54d-42a6-b914-c60f786a84ea</serial>
Oct 20 15:21:15 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:21:15 user nova-compute[76870]: </disk>
Oct 20 15:21:15 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:21:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config.
Oct 20 15:21:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:21:15 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:21:15 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:21:15 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:21:15 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:21:15 user nova-compute[76870]:   <serial>986f5d32-e54d-42a6-b914-c60f786a84ea</serial>
Oct 20 15:21:15 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:21:15 user nova-compute[76870]: </disk>
Oct 20 15:21:15 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updating instance_info_cache with network_info: [{"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-457c0e79-06f4-4411-b1cc-200e9275d114" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:16 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:18 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:21:18 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=24.70101547241211GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 106b927c-992c-4bc2-8471-96d252a290ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:21:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:21:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:21:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d is timed out.
Oct 20 15:21:36 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config.
Oct 20 15:21:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRKPsAHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:21:36 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[16063f3d-ac56-4043-9935-78f5e04603d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:21:36 user nova-compute[76870]: No targets found.
Oct 20 15:21:36 user nova-compute[76870]: iSNS:
Oct 20 15:21:36 user nova-compute[76870]: No targets found.
Oct 20 15:21:36 user nova-compute[76870]: STATIC:
Oct 20 15:21:36 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7
Oct 20 15:21:36 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:21:36 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:21:36 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:21:36 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:21:36 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:21:36 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea
Oct 20 15:21:36 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:21:36 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:21:36 user nova-compute[76870]: FIRMWARE:
Oct 20 15:21:36 user nova-compute[76870]: No targets found.
Oct 20 15:21:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:21:36 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:21:36 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02f105-654d-4643-98ab-873b06f5ca59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5924afe7-72e9-4e25-aa58-4e05f4c589a6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:21:36 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:21:36 user nova-compute[76870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea (non-flash)
Oct 20 15:21:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:21:36 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:21:36 user nova-compute[76870]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea (non-flash)
Oct 20 15:21:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec2c243400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d20be5-1cd0-4ead-93a3-6618af076ebc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4ed7a-4702-4830-8a90-c6d59ec72aca]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4669384b-8157-480d-890b-af203fc89e2c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dac930-a4cd-4b48-903c-acecd66d1d44]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5969bf-8cf8-4c10-b702-efccd7b25959]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[98acf5f5-5711-4f97-9796-4d0b0279589c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260]
Oct 20 15:21:36 user nova-compute[76870]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea, portal: 172.16.0.220,3260] successful.
Oct 20 15:21:36 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f5d32-e54d-42a6-b914-c60f786a84ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9a235-1fb1-4d83-9a50-d39837b5e697]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== disconnect_volume: return (287ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:21:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:21:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:21:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-dfe19bf8-1ea9-420e-bc7f-6ddc38adaac5 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:21:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:21:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:21:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:21:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:21:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:22:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:22:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:08 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:22:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:10 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:10 user nova-compute[76870]: DEBUG nova.objects.instance [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:11 user nova-compute[76870]: INFO nova.compute.manager [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attaching volume 1238f3fa-a94e-4ca2-9226-c4e1c0347810 to /dev/vdb
Oct 20 15:22:11 user nova-compute[76870]: DEBUG os_brick.utils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6643bfb-31ec-48dd-b76a-5a811d86c3eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e934c-9e12-43a1-b04a-7709773c0df5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a56dd7-faed-402d-843e-2bb4990a40db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6dddf-be24-4dbe-90e4-6712487d8f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:22:11 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:22:11 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a2c4c0-ea09-4776-a1ab-f8a49e5a134d]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG os_brick.utils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:22:11 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating existing volume attachment record: 5c6105a5-d5e6-4a0b-8d91-8f624d5862a5 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:22:14 user nova-compute[76870]: INFO nova.compute.manager [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Unrescuing
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquired lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG nova.network.neutron [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG nova.network.neutron [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updating instance_info_cache with network_info: [{"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Releasing lock "refresh_cache-106b927c-992c-4bc2-8471-96d252a290ce" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG nova.objects.instance [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'flavor' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f8f6571-574d-4e6b-b2d7-02bd703dd768 req-05ed06f2-8319-46ed-91c8-83b68837305d service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8f8f6571-574d-4e6b-b2d7-02bd703dd768 req-05ed06f2-8319-46ed-91c8-83b68837305d service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8f8f6571-574d-4e6b-b2d7-02bd703dd768 req-05ed06f2-8319-46ed-91c8-83b68837305d service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-8f8f6571-574d-4e6b-b2d7-02bd703dd768 req-05ed06f2-8319-46ed-91c8-83b68837305d service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG nova.compute.manager [req-8f8f6571-574d-4e6b-b2d7-02bd703dd768 req-05ed06f2-8319-46ed-91c8-83b68837305d service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:14 user nova-compute[76870]: WARNING nova.compute.manager [req-8f8f6571-574d-4e6b-b2d7-02bd703dd768 req-05ed06f2-8319-46ed-91c8-83b68837305d service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance destroyed successfully.
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:16 user nova-compute[76870]: WARNING nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:16 user nova-compute[76870]: WARNING nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:16 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:16 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:17 user nova-compute[76870]: WARNING nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:17 user nova-compute[76870]: WARNING nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:17 user nova-compute[76870]: WARNING nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:17 user nova-compute[76870]: WARNING nova.compute.manager [req-59269690-e13a-40f1-ae06-5f4494770265 req-97c71eb9-34bd-4dd4-91c4-383ca1b3ae15 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:17 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-02ff9c06-5bf1-4f27-9379-868a279a78dd req-e87163dc-c903-43f3-8f79-850781e9bbdf service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-02ff9c06-5bf1-4f27-9379-868a279a78dd req-e87163dc-c903-43f3-8f79-850781e9bbdf service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-02ff9c06-5bf1-4f27-9379-868a279a78dd req-e87163dc-c903-43f3-8f79-850781e9bbdf service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-02ff9c06-5bf1-4f27-9379-868a279a78dd req-e87163dc-c903-43f3-8f79-850781e9bbdf service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.manager [req-02ff9c06-5bf1-4f27-9379-868a279a78dd req-e87163dc-c903-43f3-8f79-850781e9bbdf service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:22:19 user nova-compute[76870]: WARNING nova.compute.manager [req-02ff9c06-5bf1-4f27-9379-868a279a78dd req-e87163dc-c903-43f3-8f79-850781e9bbdf service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state rescued and task_state unrescuing.
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-cf159eb3-8583-4cb8-813c-e42db350d484 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:22:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:22:19 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=24.69204330444336GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 106b927c-992c-4bc2-8471-96d252a290ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:22:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:22:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:22:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:22:21 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating instance_info_cache with network_info: [{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:22:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:22:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:22:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:22:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAdTpcWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:22:29 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:22:29 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:22:29 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd85b12-fbae-4010-8d0e-5816db49e8fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:22:29 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cafa861-6898-4ac5-8d63-8c686dc72d61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810] added
Oct 20 15:22:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62acda9-23ec-472c-8706-4b811935d11b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[422bfa29-558b-4994-9a8a-7d0dc1df8753]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HAdTpcWX {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HAdTpcWX" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2bd35-a01a-424a-b841-b34f641978b6]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HAdTpcWX'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[91af046c-842b-406b-889f-6f73c4dd4938]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede5ba6-fd8b-4c33-857b-a240b3197a03]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:22:29 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:22:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:22:29 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:22:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b38d37-b573-4a61-8eac-4bac5d8c85c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260]
Oct 20 15:22:29 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260] successful.
Oct 20 15:22:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[97686d7c-eef2-43c7-800a-967f769b4501]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2785cef1-72be-42ea-a7a8-9ecd954c2a98]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:22:29 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:22:29 user nova-compute[76870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 (non-flash)
Oct 20 15:22:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:22:29 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:22:29 user nova-compute[76870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 (non-flash)
Oct 20 15:22:29 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d53b74-be1d-41e2-b754-15ca554bdc07]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:22:29 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAdTpcWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26131623232666163', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131623232666163', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG nova.objects.instance [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:22:30 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:22:30 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:22:30 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:22:30 user nova-compute[76870]:   <serial>1238f3fa-a94e-4ca2-9226-c4e1c0347810</serial>
Oct 20 15:22:30 user nova-compute[76870]: </disk>
Oct 20 15:22:30 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:22:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No VIF found with MAC fa:16:3e:d6:50:51, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-442d2ecb-1fb7-4fa4-9231-c735705d7611 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.857s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:22:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:22:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:22:33 user nova-compute[76870]: INFO nova.compute.manager [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Detaching volume 1238f3fa-a94e-4ca2-9226-c4e1c0347810
Oct 20 15:22:33 user nova-compute[76870]: INFO nova.virt.block_device [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attempting to driver detach volume 1238f3fa-a94e-4ca2-9226-c4e1c0347810 from mountpoint /dev/vdb
Oct 20 15:22:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Attempting to detach device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:22:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:22:33 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:22:33 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:22:33 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:22:33 user nova-compute[76870]:   <serial>1238f3fa-a94e-4ca2-9226-c4e1c0347810</serial>
Oct 20 15:22:33 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:22:33 user nova-compute[76870]: </disk>
Oct 20 15:22:33 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:22:33 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config.
Oct 20 15:22:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:22:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:22:33 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:22:33 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:22:33 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:22:33 user nova-compute[76870]:   <serial>1238f3fa-a94e-4ca2-9226-c4e1c0347810</serial>
Oct 20 15:22:33 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:22:33 user nova-compute[76870]: </disk>
Oct 20 15:22:33 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:22:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:22:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:22:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:22:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:22:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:22:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:22:53 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d is timed out.
Oct 20 15:22:53 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config.
Oct 20 15:22:53 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAdTpcWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:22:53 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f8a3ff-162f-47a7-9d3e-921d8fbb83b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:22:53 user nova-compute[76870]: No targets found.
Oct 20 15:22:53 user nova-compute[76870]: iSNS:
Oct 20 15:22:53 user nova-compute[76870]: No targets found.
Oct 20 15:22:53 user nova-compute[76870]: STATIC:
Oct 20 15:22:53 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7
Oct 20 15:22:53 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:22:53 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:22:53 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810
Oct 20 15:22:53 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:22:53 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:22:53 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:22:53 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:22:53 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:22:53 user nova-compute[76870]: FIRMWARE:
Oct 20 15:22:53 user nova-compute[76870]: No targets found.
Oct 20 15:22:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:22:53 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:22:53 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd852e-924a-43a8-8ae2-8fa9aa09b0c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403e5c2-fdc2-46fd-ba77-bd61ff8b203e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:22:53 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:22:53 user nova-compute[76870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 (non-flash)
Oct 20 15:22:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:22:53 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:22:53 user nova-compute[76870]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 (non-flash)
Oct 20 15:22:53 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c1f15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a91a8d1-75d5-42da-a962-e73db3d9286a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f7dcf0-18f4-44fa-a4d8-cb81cf5ab8e8]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f56bb6-393c-430d-a097-0761085f49b2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab994c5-0275-4c89-9075-840f7a8757b3]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[693db378-db49-442e-99ae-3d91d8252e9b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:53 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c1f86-6879-4ed4-ab72-be1e215efa81]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260]
Oct 20 15:22:54 user nova-compute[76870]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810, portal: 172.16.0.220,3260] successful.
Oct 20 15:22:54 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1238f3fa-a94e-4ca2-9226-c4e1c0347810 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[47875752-6ddf-47aa-91f1-c5c3cc8a1ad2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== disconnect_volume: return (297ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG nova.objects.instance [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:22:54 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-7b352177-ae65-4557-a136-1e6abb748229 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:22:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:22:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:22:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:22:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:09 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:23:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:23:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:23:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:23:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:23:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:23:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:23:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:23:17 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [{"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-d76f1201-1935-45a3-a6cb-878c77a7e57d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:18 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:23:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=24.691967010498047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 106b927c-992c-4bc2-8471-96d252a290ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:23:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:23:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:23:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG nova.objects.instance [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:23:28 user nova-compute[76870]: INFO nova.compute.manager [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attaching volume eb15c1c1-740b-48a2-accf-304c942b59d8 to /dev/vdb
Oct 20 15:23:28 user nova-compute[76870]: DEBUG os_brick.utils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a46ee8-92c2-453f-9d4c-15bd43f74c7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f55ed51-47e8-4204-b1b3-7507218617ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb14a26-e2a1-43fd-924d-3523df09b1ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a02c3b5-6c75-45cd-bb0c-436c403b62e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:23:28 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:23:28 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3305ef2f-205a-4302-bca6-b32bcb9381be]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG os_brick.utils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:23:28 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating existing volume attachment record: f15ec223-f6cc-4cdb-a4a3-380f644478ee {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:23:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:23:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:23:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:23:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTZndevb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:23:45 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:23:45 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:23:45 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80fb355-07cb-4792-9bea-b03df3aaa297]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:23:45 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9b6ba7-bf33-49e7-aa0f-01c091f4c41e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8] added
Oct 20 15:23:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e790d591-913e-40c6-af80-19472d9f707d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658475d-54a5-4632-bc77-163266c62caf]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTZndevb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTZndevb" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aefa67-e325-442b-a30b-4413c4ca7950]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTZndevb'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f53b734-3713-4b1d-88dd-c11b855c0eb2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[940407ce-5b71-426f-b22e-18726f294669]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:23:45 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:23:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:23:45 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:23:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[829698dd-4d36-416b-9207-4613c28c7459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260]
Oct 20 15:23:45 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260] successful.
Oct 20 15:23:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[db51400c-2962-4a93-ac6e-e44901744593]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f62f4-a2c5-46b6-9d17-6be0ac5cacde]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:23:45 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:23:45 user nova-compute[76870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)
Oct 20 15:23:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:23:45 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:23:45 user nova-compute[76870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)
Oct 20 15:23:45 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f15a0-7d50-4db0-b67b-b6b65bd89b14]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:23:45 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTZndevb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23461316333633431', 'path': '/dev/sdd'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461316333633431', 'path': '/dev/sdd'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG nova.objects.instance [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 15:23:46 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:23:46 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:23:46 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:23:46 user nova-compute[76870]:   <serial>eb15c1c1-740b-48a2-accf-304c942b59d8</serial>
Oct 20 15:23:46 user nova-compute[76870]: </disk>
Oct 20 15:23:46 user nova-compute[76870]:  {{(pid=76870) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:23:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] No VIF found with MAC fa:16:3e:d6:50:51, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:23:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-57cf7c48-faa4-4a2f-8780-524ece5aabcc tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.459s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:23:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:23:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:23:49 user nova-compute[76870]: INFO nova.compute.manager [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Detaching volume eb15c1c1-740b-48a2-accf-304c942b59d8
Oct 20 15:23:49 user nova-compute[76870]: INFO nova.virt.block_device [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Attempting to driver detach volume eb15c1c1-740b-48a2-accf-304c942b59d8 from mountpoint /dev/vdb
Oct 20 15:23:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Attempting to detach device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config. {{(pid=76870) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 15:23:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:23:49 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:23:49 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:23:49 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:23:49 user nova-compute[76870]:   <serial>eb15c1c1-740b-48a2-accf-304c942b59d8</serial>
Oct 20 15:23:49 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:23:49 user nova-compute[76870]: </disk>
Oct 20 15:23:49 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:23:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the persistent domain config.
Oct 20 15:23:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config. {{(pid=76870) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 15:23:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.guest [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 15:23:49 user nova-compute[76870]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:23:49 user nova-compute[76870]:   <source dev="/dev/sdd"/>
Oct 20 15:23:49 user nova-compute[76870]:   <target dev="vdb" bus="virtio"/>
Oct 20 15:23:49 user nova-compute[76870]:   <serial>eb15c1c1-740b-48a2-accf-304c942b59d8</serial>
Oct 20 15:23:49 user nova-compute[76870]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 15:23:49 user nova-compute[76870]: </disk>
Oct 20 15:23:49 user nova-compute[76870]:  {{(pid=76870) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 15:23:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 15:23:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:23:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "106b927c-992c-4bc2-8471-96d252a290ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:04 user nova-compute[76870]: INFO nova.compute.manager [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Terminating instance
Oct 20 15:24:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-75eb2d85-48de-4187-8ce6-cfb68f1ca25f req-71715901-c57e-4183-80c6-e2a4654c1b6e service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-75eb2d85-48de-4187-8ce6-cfb68f1ca25f req-71715901-c57e-4183-80c6-e2a4654c1b6e service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-75eb2d85-48de-4187-8ce6-cfb68f1ca25f req-71715901-c57e-4183-80c6-e2a4654c1b6e service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-75eb2d85-48de-4187-8ce6-cfb68f1ca25f req-71715901-c57e-4183-80c6-e2a4654c1b6e service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-75eb2d85-48de-4187-8ce6-cfb68f1ca25f req-71715901-c57e-4183-80c6-e2a4654c1b6e service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.compute.manager [req-75eb2d85-48de-4187-8ce6-cfb68f1ca25f req-71715901-c57e-4183-80c6-e2a4654c1b6e service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-unplugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Instance destroyed successfully.
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'resources' on Instance uuid 106b927c-992c-4bc2-8471-96d252a290ce {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:18:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1979408968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1979408968',id=49,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-wjyvea46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:22:19Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=106b927c-992c-4bc2-8471-96d252a290ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "address": "fa:16:3e:14:88:ae", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfe660d-18", "ovs_interfaceid": "3bfe660d-18ff-4cb2-8b69-dfd8d725d91c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_vif [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bfe660d-18, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e039991b-efd6-4f7e-ab55-48cd11fe3c25) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:05 user nova-compute[76870]: INFO os_vif [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:88:ae,bridge_name='br-int',has_traffic_filtering=True,id=3bfe660d-18ff-4cb2-8b69-dfd8d725d91c,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfe660d-18')
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvbgzPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:24:05 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f984d-259f-456e-a788-0e2817b4945e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:24:05 user nova-compute[76870]: No targets found.
Oct 20 15:24:05 user nova-compute[76870]: iSNS:
Oct 20 15:24:05 user nova-compute[76870]: No targets found.
Oct 20 15:24:05 user nova-compute[76870]: STATIC:
Oct 20 15:24:05 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7
Oct 20 15:24:05 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:24:05 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:24:05 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:24:05 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:24:05 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:24:05 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8
Oct 20 15:24:05 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:24:05 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:24:05 user nova-compute[76870]: FIRMWARE:
Oct 20 15:24:05 user nova-compute[76870]: No targets found.
Oct 20 15:24:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:24:05 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:24:05 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc059d8-01bb-40f3-8631-3b4e5d00b1bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd509e0c-9328-46ae-8150-dc48434ae744]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:24:05 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:24:05 user nova-compute[76870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)
Oct 20 15:24:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:24:05 user nova-compute[76870]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 (non-flash)
Oct 20 15:24:05 user nova-compute[76870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)
Oct 20 15:24:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec2e33cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b415e1e-b5ae-4171-90de-7fb118ac87b8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b181cd6-5563-4784-a5fd-70eb26a6882b]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[397fcb5d-0fcc-442f-8fa9-a8a4f4e844c4]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[757792f7-10da-4a66-85ea-14f040a5fe63]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23063313236636261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5c948439', '/dev/disk/by-id/scsi-1SCST_BIO5c948439-0c126cba183d8b0c') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0bb48d-11ee-4689-a6d4-bd47d565bba6]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2bd35a-d8ef-4846-99ec-4842a8dbb360]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29d1ab-ae1d-48c9-a856-f38eab64f22c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260]
Oct 20 15:24:05 user nova-compute[76870]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7, portal: 172.16.0.220,3260] successful.
Oct 20 15:24:05 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998986ca-d4e8-4a97-bdd3-d049a1e8bdf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ea4ee-0b87-4022-b4cc-9d27745a129e]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== disconnect_volume: return (302ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:24:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Deleting instance files /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce_del
Oct 20 15:24:05 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Deletion of /opt/stack/data/nova/instances/106b927c-992c-4bc2-8471-96d252a290ce_del complete
Oct 20 15:24:05 user nova-compute[76870]: INFO nova.compute.manager [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 20 15:24:05 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:24:05 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:24:07 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:24:07 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Took 1.07 seconds to deallocate network for instance.
Oct 20 15:24:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:24:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] Acquiring lock "106b927c-992c-4bc2-8471-96d252a290ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] Lock "106b927c-992c-4bc2-8471-96d252a290ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] No waiting events found dispatching network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:24:07 user nova-compute[76870]: WARNING nova.compute.manager [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received unexpected event network-vif-plugged-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c for instance with vm_state active and task_state deleting.
Oct 20 15:24:07 user nova-compute[76870]: DEBUG nova.compute.manager [req-a051f9bd-a042-45af-bd50-c8974f47a7c4 req-6caaeb08-8112-4797-a494-e7d3609db119 service nova] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Received event network-vif-deleted-3bfe660d-18ff-4cb2-8b69-dfd8d725d91c {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:24:07 user nova-compute[76870]: INFO nova.compute.manager [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 106b927c-992c-4bc2-8471-96d252a290ce] Took 0.89 seconds to detach 1 volumes for instance.
Oct 20 15:24:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:08 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:24:08 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:24:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:08 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Deleted allocations for instance 106b927c-992c-4bc2-8471-96d252a290ce
Oct 20 15:24:08 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c1371155-0e54-4945-8076-cc22d06c2476 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "106b927c-992c-4bc2-8471-96d252a290ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.479s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:10 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d is timed out.
Oct 20 15:24:10 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully detached device vdb from instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d from the live domain config.
Oct 20 15:24:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTZndevb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:24:10 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668d1fa-d699-4fb2-8a9d-da60bf166cf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:24:10 user nova-compute[76870]: No targets found.
Oct 20 15:24:10 user nova-compute[76870]: iSNS:
Oct 20 15:24:10 user nova-compute[76870]: No targets found.
Oct 20 15:24:10 user nova-compute[76870]: STATIC:
Oct 20 15:24:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:24:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:24:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:24:10 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8
Oct 20 15:24:10 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:24:10 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:24:10 user nova-compute[76870]: FIRMWARE:
Oct 20 15:24:10 user nova-compute[76870]: No targets found.
Oct 20 15:24:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:24:10 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:24:10 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e7ab09-3541-4051-9d30-bea62da24f97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a657c8e-5c27-46b5-be54-984a9e7ea327]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:24:10 user nova-compute[76870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)
Oct 20 15:24:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:24:10 user nova-compute[76870]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 (non-flash)
Oct 20 15:24:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf846b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8'): ({'sdd'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Removing single pathed devices sdd {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb5e7b-b0fe-447f-a0ad-e01b4bf72d03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bcd925-906e-4b8a-845c-ec801a91df35]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Flushing IO for device /dev/sdd {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d98a85b-85c2-4510-805c-0f1073a28a19]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d100e6e2-1006-4f32-865e-75b0aed0a74f]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] SCSI volumes sdd have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[96324539-864b-46cf-93ac-45266379ecb0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a3170-6db0-42a0-9065-71e47d8fd2f1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260]
Oct 20 15:24:10 user nova-compute[76870]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8, portal: 172.16.0.220,3260] successful.
Oct 20 15:24:10 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb15c1c1-740b-48a2-accf-304c942b59d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f459f4-d9fe-4f74-93bc-92e2aee275e8]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] <== disconnect_volume: return (288ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:10 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:24:11 user nova-compute[76870]: DEBUG nova.objects.instance [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'flavor' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:24:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-73261516-72fb-45ea-b6ea-f6c5379539c2 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:24:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:24:17 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:24:17 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:24:18 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [{"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:24:18 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:24:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:24:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:24:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:24:21 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:24:21 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=24.69061279296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 457c0e79-06f4-4411-b1cc-200e9275d114 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:24:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:24:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "457c0e79-06f4-4411-b1cc-200e9275d114" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:55 user nova-compute[76870]: INFO nova.compute.manager [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Terminating instance
Oct 20 15:24:55 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-1a143308-05e3-4475-ae25-4e85150f4434 req-e0469d31-bc2b-4d3f-9c7e-1a3c1c309236 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-vif-unplugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1a143308-05e3-4475-ae25-4e85150f4434 req-e0469d31-bc2b-4d3f-9c7e-1a3c1c309236 service nova] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1a143308-05e3-4475-ae25-4e85150f4434 req-e0469d31-bc2b-4d3f-9c7e-1a3c1c309236 service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-1a143308-05e3-4475-ae25-4e85150f4434 req-e0469d31-bc2b-4d3f-9c7e-1a3c1c309236 service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-1a143308-05e3-4475-ae25-4e85150f4434 req-e0469d31-bc2b-4d3f-9c7e-1a3c1c309236 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] No waiting events found dispatching network-vif-unplugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-1a143308-05e3-4475-ae25-4e85150f4434 req-e0469d31-bc2b-4d3f-9c7e-1a3c1c309236 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-vif-unplugged-88682581-9736-40dc-86d6-001abcd82dd4 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Instance destroyed successfully.
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'resources' on Instance uuid 457c0e79-06f4-4411-b1cc-200e9275d114 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-124391435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-124391435',id=47,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-fkb1vgin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:17:31Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=457c0e79-06f4-4411-b1cc-200e9275d114,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "88682581-9736-40dc-86d6-001abcd82dd4", "address": "fa:16:3e:b9:4f:20", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88682581-97", "ovs_interfaceid": "88682581-9736-40dc-86d6-001abcd82dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG os_vif [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88682581-97, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=371be233-ebfa-4f75-a44a-ab717f95cb85) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:24:56 user nova-compute[76870]: INFO os_vif [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:4f:20,bridge_name='br-int',has_traffic_filtering=True,id=88682581-9736-40dc-86d6-001abcd82dd4,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88682581-97')
Oct 20 15:24:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Deleting instance files /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114_del
Oct 20 15:24:56 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Deletion of /opt/stack/data/nova/instances/457c0e79-06f4-4411-b1cc-200e9275d114_del complete
Oct 20 15:24:56 user nova-compute[76870]: INFO nova.compute.manager [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 15:24:56 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:24:56 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:24:57 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:24:57 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Took 0.63 seconds to deallocate network for instance.
Oct 20 15:24:57 user nova-compute[76870]: DEBUG nova.compute.manager [req-c63088d3-fc07-41b2-ad0a-4d8467c2cd09 req-012d0570-54cc-4876-998b-fcaacb1f6165 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-vif-deleted-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:24:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:57 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:24:57 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:24:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:57 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Deleted allocations for instance 457c0e79-06f4-4411-b1cc-200e9275d114
Oct 20 15:24:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b4f2a02a-32f4-4915-9d0b-8c6f7e4ea1e6 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "457c0e79-06f4-4411-b1cc-200e9275d114" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-ba6d30a6-0fd0-4c6a-8d6a-70d2113e97ce req-65016526-47b6-4af5-8c89-37d0fb3c04c2 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received event network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:24:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ba6d30a6-0fd0-4c6a-8d6a-70d2113e97ce req-65016526-47b6-4af5-8c89-37d0fb3c04c2 service nova] Acquiring lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:24:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ba6d30a6-0fd0-4c6a-8d6a-70d2113e97ce req-65016526-47b6-4af5-8c89-37d0fb3c04c2 service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:24:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ba6d30a6-0fd0-4c6a-8d6a-70d2113e97ce req-65016526-47b6-4af5-8c89-37d0fb3c04c2 service nova] Lock "457c0e79-06f4-4411-b1cc-200e9275d114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:24:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-ba6d30a6-0fd0-4c6a-8d6a-70d2113e97ce req-65016526-47b6-4af5-8c89-37d0fb3c04c2 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] No waiting events found dispatching network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:24:58 user nova-compute[76870]: WARNING nova.compute.manager [req-ba6d30a6-0fd0-4c6a-8d6a-70d2113e97ce req-65016526-47b6-4af5-8c89-37d0fb3c04c2 service nova] [instance: 457c0e79-06f4-4411-b1cc-200e9275d114] Received unexpected event network-vif-plugged-88682581-9736-40dc-86d6-001abcd82dd4 for instance with vm_state deleted and task_state None.
Oct 20 15:25:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:25:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:19 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:25:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:25:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:25:19 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating instance_info_cache with network_info: [{"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-40a3107c-65ee-4dda-bf8c-ffc7a68a073d" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:21 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:25:21 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=24.81482696533203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:25:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:25:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:46 user nova-compute[76870]: INFO nova.compute.manager [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Terminating instance
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-a667c0a2-66e6-4b6d-ad25-946f7eaf43b4 req-2d8461ce-7517-4fb7-9e7d-828e6154b7c1 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-vif-unplugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a667c0a2-66e6-4b6d-ad25-946f7eaf43b4 req-2d8461ce-7517-4fb7-9e7d-828e6154b7c1 service nova] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a667c0a2-66e6-4b6d-ad25-946f7eaf43b4 req-2d8461ce-7517-4fb7-9e7d-828e6154b7c1 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-a667c0a2-66e6-4b6d-ad25-946f7eaf43b4 req-2d8461ce-7517-4fb7-9e7d-828e6154b7c1 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-a667c0a2-66e6-4b6d-ad25-946f7eaf43b4 req-2d8461ce-7517-4fb7-9e7d-828e6154b7c1 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] No waiting events found dispatching network-vif-unplugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-a667c0a2-66e6-4b6d-ad25-946f7eaf43b4 req-2d8461ce-7517-4fb7-9e7d-828e6154b7c1 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-vif-unplugged-b26352ce-aff3-4162-9b40-e215adc9ed64 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:46 user nova-compute[76870]: INFO nova.compute.manager [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Terminating instance
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Instance destroyed successfully.
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.objects.instance [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lazy-loading 'resources' on Instance uuid 40a3107c-65ee-4dda-bf8c-ffc7a68a073d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-76750828',display_name='tempest-SnapshotDataIntegrityTests-server-76750828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-76750828',id=48,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdbP8Zkeq7D+TDQGJes+WR2dxCAGTZ2ldbV3OYXTnsfb31JwWac47dBQKKI69Li4bF86xS2t9bOqWrfcRfS4ZNxJlCWY6UK1qUbMKKe0xhR2n0l15+SXaFMbjJXl0Z8Ag==',key_name='tempest-keypair-566455829',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:17:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb268f2cefbf4d96b06187b7ce223848',ramdisk_id='',reservation_id='r-3y67o0yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1729309471',owner_user_name='tempest-SnapshotDataIntegrityTests-1729309471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='028ee7da03674a658749883af4ad3c47',uuid=40a3107c-65ee-4dda-bf8c-ffc7a68a073d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Converting VIF {"id": "b26352ce-aff3-4162-9b40-e215adc9ed64", "address": "fa:16:3e:d6:50:51", "network": {"id": "21039932-38b2-40c6-a012-7b6b6e6c3b04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1996729105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb268f2cefbf4d96b06187b7ce223848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26352ce-af", "ovs_interfaceid": "b26352ce-aff3-4162-9b40-e215adc9ed64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG os_vif [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-bac646a7-7733-49a7-b280-2d1591088835 req-eb26f567-b612-4f62-ae59-5a04f3068aee service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bac646a7-7733-49a7-b280-2d1591088835 req-eb26f567-b612-4f62-ae59-5a04f3068aee service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bac646a7-7733-49a7-b280-2d1591088835 req-eb26f567-b612-4f62-ae59-5a04f3068aee service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bac646a7-7733-49a7-b280-2d1591088835 req-eb26f567-b612-4f62-ae59-5a04f3068aee service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-bac646a7-7733-49a7-b280-2d1591088835 req-eb26f567-b612-4f62-ae59-5a04f3068aee service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-bac646a7-7733-49a7-b280-2d1591088835 req-eb26f567-b612-4f62-ae59-5a04f3068aee service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-unplugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb26352ce-af, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31f7440b-9a59-4962-8197-656ab06e5b9a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: INFO os_vif [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:50:51,bridge_name='br-int',has_traffic_filtering=True,id=b26352ce-aff3-4162-9b40-e215adc9ed64,network=Network(21039932-38b2-40c6-a012-7b6b6e6c3b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26352ce-af')
Oct 20 15:25:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Deleting instance files /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d_del
Oct 20 15:25:46 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Deletion of /opt/stack/data/nova/instances/40a3107c-65ee-4dda-bf8c-ffc7a68a073d_del complete
Oct 20 15:25:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:46 user nova-compute[76870]: INFO nova.compute.manager [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:25:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Instance destroyed successfully.
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.objects.instance [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'resources' on Instance uuid c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-740900847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-740900847',id=46,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:11:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-daazh38d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:13:47Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "address": "fa:16:3e:d1:19:8c", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e6ab6d-fc", "ovs_interfaceid": "c4e6ab6d-fc28-44d7-8786-af1cd4986412", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_vif [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4e6ab6d-fc, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75a0551d-3c96-4d05-bbe5-aa10aa0cc21b) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:47 user nova-compute[76870]: INFO os_vif [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c4e6ab6d-fc28-44d7-8786-af1cd4986412,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e6ab6d-fc')
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwWRMEGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:25:47 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02660cd-6e34-419a-96fb-d46b346c4fd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:25:47 user nova-compute[76870]: No targets found.
Oct 20 15:25:47 user nova-compute[76870]: iSNS:
Oct 20 15:25:47 user nova-compute[76870]: No targets found.
Oct 20 15:25:47 user nova-compute[76870]: STATIC:
Oct 20 15:25:47 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd
Oct 20 15:25:47 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:25:47 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:25:47 user nova-compute[76870]: FIRMWARE:
Oct 20 15:25:47 user nova-compute[76870]: No targets found.
Oct 20 15:25:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:25:47 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:25:47 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b03a9-c06d-4595-b010-27657d47ff56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f097883b-485b-44f2-908a-e6c7b712e783]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:25:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd (non-flash)
Oct 20 15:25:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c1f1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd'): ({'sdc'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Removing single pathed devices sdc {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e665d0-ae7d-4dee-b8b2-6994db545a0b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f4d92-2ba8-4b1f-902b-ccf9a9fc1bbf]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Flushing IO for device /dev/sdc {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a168f3-8028-44c3-b42b-8d46fab88f71]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[152cdb3c-e625-4946-9365-b889bc5ee6f0]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] SCSI volumes sdc have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b358013-dbf5-4651-baa3-0db477a999d0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765d175-a6df-4430-90de-d4b561282d2b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260]
Oct 20 15:25:47 user nova-compute[76870]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd, portal: 172.16.0.220,3260] successful.
Oct 20 15:25:47 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a815a88b-6206-4be6-9c18-eaabd121a6fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a0dd63-f22e-475d-bc2d-a03317a59d7a]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] <== disconnect_volume: return (283ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:25:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Deleting instance files /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424_del
Oct 20 15:25:47 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Deletion of /opt/stack/data/nova/instances/c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424_del complete
Oct 20 15:25:47 user nova-compute[76870]: INFO nova.compute.manager [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 20 15:25:47 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:25:47 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Took 0.90 seconds to deallocate network for instance.
Oct 20 15:25:47 user nova-compute[76870]: DEBUG nova.compute.manager [req-f1dd89ee-4844-4ce6-bb83-0656f5624771 req-e1d8db44-2fe0-434b-b8cf-328ddfc08a3f service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-vif-deleted-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:25:48 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Took 0.47 seconds to deallocate network for instance.
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:48 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Deleted allocations for instance 40a3107c-65ee-4dda-bf8c-ffc7a68a073d
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-c342cc14-fd10-48b4-a27a-23db50c82c32 tempest-SnapshotDataIntegrityTests-1729309471 tempest-SnapshotDataIntegrityTests-1729309471-project-member] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received event network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] Acquiring lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] Lock "40a3107c-65ee-4dda-bf8c-ffc7a68a073d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] No waiting events found dispatching network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:25:48 user nova-compute[76870]: WARNING nova.compute.manager [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] [instance: 40a3107c-65ee-4dda-bf8c-ffc7a68a073d] Received unexpected event network-vif-plugged-b26352ce-aff3-4162-9b40-e215adc9ed64 for instance with vm_state deleted and task_state None.
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-9f75ed01-bd83-44d1-9a97-96f6cc1af021 req-25396331-adb4-45f2-8a0b-ee7eafc993a0 service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-deleted-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-943e36d5-7496-4cba-a439-48abd0eb5b4d req-3e197507-90fd-44b6-bfe1-4c5544a2acbb service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-943e36d5-7496-4cba-a439-48abd0eb5b4d req-3e197507-90fd-44b6-bfe1-4c5544a2acbb service nova] Acquiring lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-943e36d5-7496-4cba-a439-48abd0eb5b4d req-3e197507-90fd-44b6-bfe1-4c5544a2acbb service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-943e36d5-7496-4cba-a439-48abd0eb5b4d req-3e197507-90fd-44b6-bfe1-4c5544a2acbb service nova] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-943e36d5-7496-4cba-a439-48abd0eb5b4d req-3e197507-90fd-44b6-bfe1-4c5544a2acbb service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] No waiting events found dispatching network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:25:48 user nova-compute[76870]: WARNING nova.compute.manager [req-943e36d5-7496-4cba-a439-48abd0eb5b4d req-3e197507-90fd-44b6-bfe1-4c5544a2acbb service nova] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Received unexpected event network-vif-plugged-c4e6ab6d-fc28-44d7-8786-af1cd4986412 for instance with vm_state active and task_state deleting.
Oct 20 15:25:48 user nova-compute[76870]: INFO nova.compute.manager [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424] Took 0.89 seconds to detach 1 volumes for instance.
Oct 20 15:25:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:25:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:25:49 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:25:49 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:25:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:49 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Deleted allocations for instance c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424
Oct 20 15:25:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-18f48cb2-a82a-4d9e-a9da-848f246b74e1 tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "c6f401ed-6ddc-4ef0-9bf8-08a90f8ee424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:25:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:25:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:12 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:26:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:26:19 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:26:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:26:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8895MB free_disk=24.841899871826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance d76f1201-1935-45a3-a6cb-878c77a7e57d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:26:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:26:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:26:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:26:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:37 user nova-compute[76870]: INFO nova.compute.manager [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Terminating instance
Oct 20 15:26:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-2e505125-76ca-4edd-b0cd-9dd60aaeb69e req-8fdec071-3a1f-4833-b197-58791768004d service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-vif-unplugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2e505125-76ca-4edd-b0cd-9dd60aaeb69e req-8fdec071-3a1f-4833-b197-58791768004d service nova] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2e505125-76ca-4edd-b0cd-9dd60aaeb69e req-8fdec071-3a1f-4833-b197-58791768004d service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2e505125-76ca-4edd-b0cd-9dd60aaeb69e req-8fdec071-3a1f-4833-b197-58791768004d service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-2e505125-76ca-4edd-b0cd-9dd60aaeb69e req-8fdec071-3a1f-4833-b197-58791768004d service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] No waiting events found dispatching network-vif-unplugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-2e505125-76ca-4edd-b0cd-9dd60aaeb69e req-8fdec071-3a1f-4833-b197-58791768004d service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-vif-unplugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:37 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Instance destroyed successfully.
Oct 20 15:26:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lazy-loading 'resources' on Instance uuid d76f1201-1935-45a3-a6cb-878c77a7e57d {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-797271511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-797271511',id=43,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:07:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f01dd35514c0d98db23904e4ad1d3',ramdisk_id='',reservation_id='r-j7hesshs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:08:57Z,user_data=None,user_id='3271422bfb4145dbad9e30dc8799aeb6',uuid=d76f1201-1935-45a3-a6cb-878c77a7e57d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converting VIF {"id": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "address": "fa:16:3e:ef:ef:07", "network": {"id": "90ee91a1-821d-439e-98cb-5a20f3828626", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-350869691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f01dd35514c0d98db23904e4ad1d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a346767-34", "ovs_interfaceid": "1a346767-34a2-4bf6-8ed0-7ab96f3af436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG os_vif [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a346767-34, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aeaec5d-c90e-4031-ace1-05354b1219e0) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:38 user nova-compute[76870]: INFO os_vif [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ef:07,bridge_name='br-int',has_traffic_filtering=True,id=1a346767-34a2-4bf6-8ed0-7ab96f3af436,network=Network(90ee91a1-821d-439e-98cb-5a20f3828626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a346767-34')
Oct 20 15:26:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Deleting instance files /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d_del
Oct 20 15:26:38 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Deletion of /opt/stack/data/nova/instances/d76f1201-1935-45a3-a6cb-878c77a7e57d_del complete
Oct 20 15:26:38 user nova-compute[76870]: INFO nova.compute.manager [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 20 15:26:38 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:26:38 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:26:39 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Took 1.11 seconds to deallocate network for instance.
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-21d01272-5452-41fe-b85b-fa63a8ed5826 req-bae995f4-5c0a-4687-9fcd-f1e7cf46ab54 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-vif-deleted-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:26:39 user nova-compute[76870]: INFO nova.compute.manager [req-21d01272-5452-41fe-b85b-fa63a8ed5826 req-bae995f4-5c0a-4687-9fcd-f1e7cf46ab54 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Neutron deleted interface 1a346767-34a2-4bf6-8ed0-7ab96f3af436; detaching it from the instance and deleting it from the info cache
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-21d01272-5452-41fe-b85b-fa63a8ed5826 req-bae995f4-5c0a-4687-9fcd-f1e7cf46ab54 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-21d01272-5452-41fe-b85b-fa63a8ed5826 req-bae995f4-5c0a-4687-9fcd-f1e7cf46ab54 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Detach interface failed, port_id=1a346767-34a2-4bf6-8ed0-7ab96f3af436, reason: Instance d76f1201-1935-45a3-a6cb-878c77a7e57d could not be found. {{(pid=76870) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-089b8901-1a55-4104-9aee-1646f6a8697c req-fa3219a8-bca9-4765-9426-3487841da644 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received event network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-089b8901-1a55-4104-9aee-1646f6a8697c req-fa3219a8-bca9-4765-9426-3487841da644 service nova] Acquiring lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-089b8901-1a55-4104-9aee-1646f6a8697c req-fa3219a8-bca9-4765-9426-3487841da644 service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-089b8901-1a55-4104-9aee-1646f6a8697c req-fa3219a8-bca9-4765-9426-3487841da644 service nova] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-089b8901-1a55-4104-9aee-1646f6a8697c req-fa3219a8-bca9-4765-9426-3487841da644 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] No waiting events found dispatching network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:26:39 user nova-compute[76870]: WARNING nova.compute.manager [req-089b8901-1a55-4104-9aee-1646f6a8697c req-fa3219a8-bca9-4765-9426-3487841da644 service nova] [instance: d76f1201-1935-45a3-a6cb-878c77a7e57d] Received unexpected event network-vif-plugged-1a346767-34a2-4bf6-8ed0-7ab96f3af436 for instance with vm_state deleted and task_state None.
Oct 20 15:26:39 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Deleted allocations for instance d76f1201-1935-45a3-a6cb-878c77a7e57d
Oct 20 15:26:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-78b5294d-f448-4d71-b4f1-af1b2e32947d tempest-ServerBootFromVolumeStableRescueTest-1789045836 tempest-ServerBootFromVolumeStableRescueTest-1789045836-project-member] Lock "d76f1201-1935-45a3-a6cb-878c77a7e57d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.524s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:26:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:26:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:26:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:26:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:26:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:26:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:27:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:13 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:27:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:21 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:27:22 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:27:22 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9095MB free_disk=24.965652465820312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:27:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:27:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:27:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:27:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:43 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "efce6f51-78d6-4e46-baad-6dd579993730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:27:44 user nova-compute[76870]: INFO nova.compute.claims [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Claim successful on node user
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:27:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.policy [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6bc6ab7d5cc4cc8a89f2050924d5742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5386e5397ae74ee4930bae7d37ec4c1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:27:44 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Creating image(s)
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "/opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "/opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "/opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:44 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.178s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk 1073741824" returned: 0 in 0.051s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Cannot resize image /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Ensure instance console log exists: /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:45 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Successfully created port: 9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Successfully updated port: 9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquired lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-changed-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.compute.manager [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Refreshing instance network info cache due to event network-changed-9972220d-292e-4825-a912-d430b4e4a7c2. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] Acquiring lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.neutron [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updating instance_info_cache with network_info: [{"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Releasing lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Instance network_info: |[{"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] Acquired lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.neutron [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Refreshing network info cache for port 9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Start _get_guest_xml network_info=[{"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:27:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:27:46 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1323484143',display_name='tempest-VolumesActionsTest-instance-1323484143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1323484143',id=50,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5386e5397ae74ee4930bae7d37ec4c1a',ramdisk_id='',reservation_id='r-04xx854i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1657306353',owner_user_name='tempest-VolumesActionsTest-1657306353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:27:45Z,user_data=None,user_id='d6bc6ab7d5cc4cc8a89f2050924d5742',uuid=efce6f51-78d6-4e46-baad-6dd579993730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Converting VIF {"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.objects.instance [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lazy-loading 'pci_devices' on Instance uuid efce6f51-78d6-4e46-baad-6dd579993730 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:27:46 user nova-compute[76870]:   <uuid>efce6f51-78d6-4e46-baad-6dd579993730</uuid>
Oct 20 15:27:46 user nova-compute[76870]:   <name>instance-00000032</name>
Oct 20 15:27:46 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:27:46 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:27:46 user nova-compute[76870]:   <metadata>
Oct 20 15:27:46 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:27:46 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:27:46 user nova-compute[76870]:       <nova:name>tempest-VolumesActionsTest-instance-1323484143</nova:name>
Oct 20 15:27:46 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:27:46</nova:creationTime>
Oct 20 15:27:46 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:27:46 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:27:46 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:27:46 user nova-compute[76870]:       <nova:owner>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:user uuid="d6bc6ab7d5cc4cc8a89f2050924d5742">tempest-VolumesActionsTest-1657306353-project-member</nova:user>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:project uuid="5386e5397ae74ee4930bae7d37ec4c1a">tempest-VolumesActionsTest-1657306353</nova:project>
Oct 20 15:27:46 user nova-compute[76870]:       </nova:owner>
Oct 20 15:27:46 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:27:46 user nova-compute[76870]:       <nova:ports>
Oct 20 15:27:46 user nova-compute[76870]:         <nova:port uuid="9972220d-292e-4825-a912-d430b4e4a7c2">
Oct 20 15:27:46 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 15:27:46 user nova-compute[76870]:         </nova:port>
Oct 20 15:27:46 user nova-compute[76870]:       </nova:ports>
Oct 20 15:27:46 user nova-compute[76870]:     </nova:instance>
Oct 20 15:27:46 user nova-compute[76870]:   </metadata>
Oct 20 15:27:46 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:27:46 user nova-compute[76870]:     <system>
Oct 20 15:27:46 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:27:46 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:27:46 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:27:46 user nova-compute[76870]:       <entry name="serial">efce6f51-78d6-4e46-baad-6dd579993730</entry>
Oct 20 15:27:46 user nova-compute[76870]:       <entry name="uuid">efce6f51-78d6-4e46-baad-6dd579993730</entry>
Oct 20 15:27:46 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:27:46 user nova-compute[76870]:     </system>
Oct 20 15:27:46 user nova-compute[76870]:   </sysinfo>
Oct 20 15:27:46 user nova-compute[76870]:   <os>
Oct 20 15:27:46 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:27:46 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:27:46 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:27:46 user nova-compute[76870]:   </os>
Oct 20 15:27:46 user nova-compute[76870]:   <features>
Oct 20 15:27:46 user nova-compute[76870]:     <acpi/>
Oct 20 15:27:46 user nova-compute[76870]:     <apic/>
Oct 20 15:27:46 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:27:46 user nova-compute[76870]:   </features>
Oct 20 15:27:46 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:27:46 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:27:46 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:27:46 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:27:46 user nova-compute[76870]:   </clock>
Oct 20 15:27:46 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:27:46 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:27:46 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:27:46 user nova-compute[76870]:   </cpu>
Oct 20 15:27:46 user nova-compute[76870]:   <devices>
Oct 20 15:27:46 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:27:46 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:27:46 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk"/>
Oct 20 15:27:46 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:27:46 user nova-compute[76870]:     </disk>
Oct 20 15:27:46 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:27:46 user nova-compute[76870]:       <mac address="fa:16:3e:ea:49:e8"/>
Oct 20 15:27:46 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:27:46 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:27:46 user nova-compute[76870]:       <target dev="tap9972220d-29"/>
Oct 20 15:27:46 user nova-compute[76870]:     </interface>
Oct 20 15:27:46 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:27:46 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/console.log" append="off"/>
Oct 20 15:27:46 user nova-compute[76870]:     </serial>
Oct 20 15:27:46 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:27:46 user nova-compute[76870]:     <video>
Oct 20 15:27:46 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:27:46 user nova-compute[76870]:     </video>
Oct 20 15:27:46 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:27:46 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:27:46 user nova-compute[76870]:     </rng>
Oct 20 15:27:46 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:27:46 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:27:46 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:27:46 user nova-compute[76870]:     </memballoon>
Oct 20 15:27:46 user nova-compute[76870]:   </devices>
Oct 20 15:27:46 user nova-compute[76870]: </domain>
Oct 20 15:27:46 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1323484143',display_name='tempest-VolumesActionsTest-instance-1323484143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1323484143',id=50,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5386e5397ae74ee4930bae7d37ec4c1a',ramdisk_id='',reservation_id='r-04xx854i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1657306353',owner_user_name='tempest-VolumesActionsTest-1657306353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:27:45Z,user_data=None,user_id='d6bc6ab7d5cc4cc8a89f2050924d5742',uuid=efce6f51-78d6-4e46-baad-6dd579993730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Converting VIF {"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG os_vif [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cadb0fa-8615-5c42-ba31-02a9ac6e9591', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9972220d-29, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9972220d-29, col_values=(('qos', UUID('24d4c84e-8a29-48be-b085-17dcc3afe37a')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9972220d-29, col_values=(('external_ids', {'iface-id': '9972220d-292e-4825-a912-d430b4e4a7c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:49:e8', 'vm-uuid': 'efce6f51-78d6-4e46-baad-6dd579993730'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:46 user nova-compute[76870]: INFO os_vif [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29')
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:27:46 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] No VIF found with MAC fa:16:3e:ea:49:e8, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:27:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updated VIF entry in instance network info cache for port 9972220d-292e-4825-a912-d430b4e4a7c2. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:27:47 user nova-compute[76870]: DEBUG nova.network.neutron [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updating instance_info_cache with network_info: [{"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:27:47 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-b9f3f448-81e6-4965-8e55-88b702958baa req-b5e327c1-cc28-4da5-adee-923396b020b9 service nova] Releasing lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-c2181f2c-35c4-4c4e-b69e-f9365188c0ed req-e4eaeccd-fb5d-4757-9da9-e4d5f2af0caa service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c2181f2c-35c4-4c4e-b69e-f9365188c0ed req-e4eaeccd-fb5d-4757-9da9-e4d5f2af0caa service nova] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c2181f2c-35c4-4c4e-b69e-f9365188c0ed req-e4eaeccd-fb5d-4757-9da9-e4d5f2af0caa service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c2181f2c-35c4-4c4e-b69e-f9365188c0ed req-e4eaeccd-fb5d-4757-9da9-e4d5f2af0caa service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG nova.compute.manager [req-c2181f2c-35c4-4c4e-b69e-f9365188c0ed req-e4eaeccd-fb5d-4757-9da9-e4d5f2af0caa service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] No waiting events found dispatching network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:27:48 user nova-compute[76870]: WARNING nova.compute.manager [req-c2181f2c-35c4-4c4e-b69e-f9365188c0ed req-e4eaeccd-fb5d-4757-9da9-e4d5f2af0caa service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received unexpected event network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 for instance with vm_state building and task_state spawning.
Oct 20 15:27:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:27:50 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Instance spawned successfully.
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:27:50 user nova-compute[76870]: INFO nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Took 5.48 seconds to spawn the instance on the hypervisor.
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:27:50 user nova-compute[76870]: INFO nova.compute.manager [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Took 5.97 seconds to build instance.
Oct 20 15:27:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-3063a3d1-8d26-4467-9460-a6e5164dd929 tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "efce6f51-78d6-4e46-baad-6dd579993730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.074s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-97fd4000-8fdd-4340-8db3-4c86499d138b req-215ae4c5-9a0f-4496-b3ee-df6dbffe3305 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-97fd4000-8fdd-4340-8db3-4c86499d138b req-215ae4c5-9a0f-4496-b3ee-df6dbffe3305 service nova] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-97fd4000-8fdd-4340-8db3-4c86499d138b req-215ae4c5-9a0f-4496-b3ee-df6dbffe3305 service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-97fd4000-8fdd-4340-8db3-4c86499d138b req-215ae4c5-9a0f-4496-b3ee-df6dbffe3305 service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [req-97fd4000-8fdd-4340-8db3-4c86499d138b req-215ae4c5-9a0f-4496-b3ee-df6dbffe3305 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] No waiting events found dispatching network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:27:50 user nova-compute[76870]: WARNING nova.compute.manager [req-97fd4000-8fdd-4340-8db3-4c86499d138b req-215ae4c5-9a0f-4496-b3ee-df6dbffe3305 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received unexpected event network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 for instance with vm_state active and task_state None.
Oct 20 15:27:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:27:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:27:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:27:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:13 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:14 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:28:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:28:22 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid efce6f51-78d6-4e46-baad-6dd579993730 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updating instance_info_cache with network_info: [{"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:28:23 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:28:24 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:28:24 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.927364349365234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance efce6f51-78d6-4e46-baad-6dd579993730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:28:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:28:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:28:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:28:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:01 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:06 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:29:11 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:14 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:29:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:16 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:29:22 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid efce6f51-78d6-4e46-baad-6dd579993730 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:29:23 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updating instance_info_cache with network_info: [{"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:29:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-efce6f51-78d6-4e46-baad-6dd579993730" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:29:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:29:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:29:24 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:29:25 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:29:25 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=24.926742553710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance efce6f51-78d6-4e46-baad-6dd579993730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:29:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:26 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:29:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:29:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:41 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:46 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "efce6f51-78d6-4e46-baad-6dd579993730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:49 user nova-compute[76870]: INFO nova.compute.manager [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Terminating instance
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.compute.manager [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-3dafe189-bbc4-4041-90c6-15caa987f430 req-0b947d73-5aa5-4f41-9a96-33053a3bab61 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-vif-unplugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3dafe189-bbc4-4041-90c6-15caa987f430 req-0b947d73-5aa5-4f41-9a96-33053a3bab61 service nova] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3dafe189-bbc4-4041-90c6-15caa987f430 req-0b947d73-5aa5-4f41-9a96-33053a3bab61 service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3dafe189-bbc4-4041-90c6-15caa987f430 req-0b947d73-5aa5-4f41-9a96-33053a3bab61 service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-3dafe189-bbc4-4041-90c6-15caa987f430 req-0b947d73-5aa5-4f41-9a96-33053a3bab61 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] No waiting events found dispatching network-vif-unplugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.compute.manager [req-3dafe189-bbc4-4041-90c6-15caa987f430 req-0b947d73-5aa5-4f41-9a96-33053a3bab61 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-vif-unplugged-9972220d-292e-4825-a912-d430b4e4a7c2 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Instance destroyed successfully.
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.objects.instance [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lazy-loading 'resources' on Instance uuid efce6f51-78d6-4e46-baad-6dd579993730 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1323484143',display_name='tempest-VolumesActionsTest-instance-1323484143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1323484143',id=50,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5386e5397ae74ee4930bae7d37ec4c1a',ramdisk_id='',reservation_id='r-04xx854i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1657306353',owner_user_name='tempest-VolumesActionsTest-1657306353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:27:50Z,user_data=None,user_id='d6bc6ab7d5cc4cc8a89f2050924d5742',uuid=efce6f51-78d6-4e46-baad-6dd579993730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Converting VIF {"id": "9972220d-292e-4825-a912-d430b4e4a7c2", "address": "fa:16:3e:ea:49:e8", "network": {"id": "7863f708-241b-481b-9514-d544a4c3eae2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1206525805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5386e5397ae74ee4930bae7d37ec4c1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9972220d-29", "ovs_interfaceid": "9972220d-292e-4825-a912-d430b4e4a7c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG os_vif [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9972220d-29, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24d4c84e-8a29-48be-b085-17dcc3afe37a) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:29:49 user nova-compute[76870]: INFO os_vif [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=9972220d-292e-4825-a912-d430b4e4a7c2,network=Network(7863f708-241b-481b-9514-d544a4c3eae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9972220d-29')
Oct 20 15:29:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Deleting instance files /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730_del
Oct 20 15:29:49 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Deletion of /opt/stack/data/nova/instances/efce6f51-78d6-4e46-baad-6dd579993730_del complete
Oct 20 15:29:49 user nova-compute[76870]: INFO nova.compute.manager [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 15:29:49 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:29:49 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: efce6f51-78d6-4e46-baad-6dd579993730] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:29:50 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:29:51 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Took 1.04 seconds to deallocate network for instance.
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:51 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Deleted allocations for instance efce6f51-78d6-4e46-baad-6dd579993730
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-2873f58b-ed34-4e31-966c-dda90d5d179d tempest-VolumesActionsTest-1657306353 tempest-VolumesActionsTest-1657306353-project-member] Lock "efce6f51-78d6-4e46-baad-6dd579993730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] Acquiring lock "efce6f51-78d6-4e46-baad-6dd579993730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] Lock "efce6f51-78d6-4e46-baad-6dd579993730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:29:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] No waiting events found dispatching network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:29:51 user nova-compute[76870]: WARNING nova.compute.manager [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received unexpected event network-vif-plugged-9972220d-292e-4825-a912-d430b4e4a7c2 for instance with vm_state deleted and task_state None.
Oct 20 15:29:51 user nova-compute[76870]: DEBUG nova.compute.manager [req-325e70f6-4d8b-4423-897d-64234ec4b285 req-2f661243-1a57-4e16-94c3-7dbeb5e9f254 service nova] [instance: efce6f51-78d6-4e46-baad-6dd579993730] Received event network-vif-deleted-9972220d-292e-4825-a912-d430b4e4a7c2 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:29:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:29:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:30:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:30:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:30:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:30:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:30:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:30:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:30:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:30:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:30:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:30:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:30:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9112MB free_disk=24.953712463378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:30:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:30:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:30:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:30:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:30:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:30:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:30:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:31:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:31:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:16 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:16 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:31:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:31:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:31:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:31:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:31:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:31:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:31:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:31:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:31:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=24.952377319335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:31:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:31:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:31:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:31:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:31:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:31:51 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:31:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:17 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:32:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:32:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:32:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:32:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:32:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:32:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:32:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:25 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:32:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:32:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=24.950565338134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:32:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:32:31 user nova-compute[76870]: INFO nova.compute.claims [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Claim successful on node user
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:32:31 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:32:31 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Creating image(s)
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "/opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "/opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "/opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG nova.policy [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '273e3005f0e4434b8435ae14ef9832f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497a5a663c8b45b0a5eff47df128f9ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.177s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk 1073741824 {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3,backing_fmt=raw /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk 1073741824" returned: 0 in 0.051s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:31 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2edbaa13e5bad41c369ad09dd5b4ffb1878f56a3 --force-share --output=json" returned: 0 in 0.180s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk. size=1073741824 {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.virt.disk.api [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Cannot resize image /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk to a smaller size. {{(pid=76870) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Created local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Ensure instance console log exists: /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Successfully created port: d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Successfully updated port: d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquired lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-changed-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.compute.manager [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Refreshing instance network info cache due to event network-changed-d8a588fe-22af-448c-a252-dcf91f597bd3. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] Acquiring lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:32:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.neutron [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Updating instance_info_cache with network_info: [{"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Releasing lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Instance network_info: |[{"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] Acquired lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.neutron [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Refreshing network info cache for port d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Start _get_guest_xml network_info=[{"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'image_id': 'fe361d9c-2878-4d9c-9fb8-7c063759e6e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:32:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:32:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T14:26:52Z,direct_url=<?>,disk_format='qcow2',id=fe361d9c-2878-4d9c-9fb8-7c063759e6e5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be3264b8c02f448d8aad2f2cd2a6d80f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T14:26:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1026342932',display_name='tempest-VolumesNegativeTest-instance-1026342932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1026342932',id=51,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='497a5a663c8b45b0a5eff47df128f9ca',ramdisk_id='',reservation_id='r-0o8e6mwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1589129395',owner_user_name='tempest-VolumesNegativeTest-1589129395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:32:31Z,user_data=None,user_id='273e3005f0e4434b8435ae14ef9832f7',uuid=7229e932-d2cd-4f8a-95f7-3312c6dac71a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Converting VIF {"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.objects.instance [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lazy-loading 'pci_devices' on Instance uuid 7229e932-d2cd-4f8a-95f7-3312c6dac71a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:32:33 user nova-compute[76870]:   <uuid>7229e932-d2cd-4f8a-95f7-3312c6dac71a</uuid>
Oct 20 15:32:33 user nova-compute[76870]:   <name>instance-00000033</name>
Oct 20 15:32:33 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:32:33 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:32:33 user nova-compute[76870]:   <metadata>
Oct 20 15:32:33 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:32:33 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:32:33 user nova-compute[76870]:       <nova:name>tempest-VolumesNegativeTest-instance-1026342932</nova:name>
Oct 20 15:32:33 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:32:33</nova:creationTime>
Oct 20 15:32:33 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:32:33 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:32:33 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:32:33 user nova-compute[76870]:       <nova:owner>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:user uuid="273e3005f0e4434b8435ae14ef9832f7">tempest-VolumesNegativeTest-1589129395-project-member</nova:user>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:project uuid="497a5a663c8b45b0a5eff47df128f9ca">tempest-VolumesNegativeTest-1589129395</nova:project>
Oct 20 15:32:33 user nova-compute[76870]:       </nova:owner>
Oct 20 15:32:33 user nova-compute[76870]:       <nova:root type="image" uuid="fe361d9c-2878-4d9c-9fb8-7c063759e6e5"/>
Oct 20 15:32:33 user nova-compute[76870]:       <nova:ports>
Oct 20 15:32:33 user nova-compute[76870]:         <nova:port uuid="d8a588fe-22af-448c-a252-dcf91f597bd3">
Oct 20 15:32:33 user nova-compute[76870]:           <nova:ip type="fixed" address="192.168.233.251" ipVersion="4"/>
Oct 20 15:32:33 user nova-compute[76870]:         </nova:port>
Oct 20 15:32:33 user nova-compute[76870]:       </nova:ports>
Oct 20 15:32:33 user nova-compute[76870]:     </nova:instance>
Oct 20 15:32:33 user nova-compute[76870]:   </metadata>
Oct 20 15:32:33 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:32:33 user nova-compute[76870]:     <system>
Oct 20 15:32:33 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:32:33 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:32:33 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:32:33 user nova-compute[76870]:       <entry name="serial">7229e932-d2cd-4f8a-95f7-3312c6dac71a</entry>
Oct 20 15:32:33 user nova-compute[76870]:       <entry name="uuid">7229e932-d2cd-4f8a-95f7-3312c6dac71a</entry>
Oct 20 15:32:33 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:32:33 user nova-compute[76870]:     </system>
Oct 20 15:32:33 user nova-compute[76870]:   </sysinfo>
Oct 20 15:32:33 user nova-compute[76870]:   <os>
Oct 20 15:32:33 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:32:33 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:32:33 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:32:33 user nova-compute[76870]:   </os>
Oct 20 15:32:33 user nova-compute[76870]:   <features>
Oct 20 15:32:33 user nova-compute[76870]:     <acpi/>
Oct 20 15:32:33 user nova-compute[76870]:     <apic/>
Oct 20 15:32:33 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:32:33 user nova-compute[76870]:   </features>
Oct 20 15:32:33 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:32:33 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:32:33 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:32:33 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:32:33 user nova-compute[76870]:   </clock>
Oct 20 15:32:33 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:32:33 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:32:33 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:32:33 user nova-compute[76870]:   </cpu>
Oct 20 15:32:33 user nova-compute[76870]:   <devices>
Oct 20 15:32:33 user nova-compute[76870]:     <disk type="file" device="disk">
Oct 20 15:32:33 user nova-compute[76870]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 15:32:33 user nova-compute[76870]:       <source file="/opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk"/>
Oct 20 15:32:33 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:32:33 user nova-compute[76870]:     </disk>
Oct 20 15:32:33 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:32:33 user nova-compute[76870]:       <mac address="fa:16:3e:d6:db:be"/>
Oct 20 15:32:33 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:32:33 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:32:33 user nova-compute[76870]:       <target dev="tapd8a588fe-22"/>
Oct 20 15:32:33 user nova-compute[76870]:     </interface>
Oct 20 15:32:33 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:32:33 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/console.log" append="off"/>
Oct 20 15:32:33 user nova-compute[76870]:     </serial>
Oct 20 15:32:33 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:32:33 user nova-compute[76870]:     <video>
Oct 20 15:32:33 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:32:33 user nova-compute[76870]:     </video>
Oct 20 15:32:33 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:32:33 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:32:33 user nova-compute[76870]:     </rng>
Oct 20 15:32:33 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:32:33 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:32:33 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:32:33 user nova-compute[76870]:     </memballoon>
Oct 20 15:32:33 user nova-compute[76870]:   </devices>
Oct 20 15:32:33 user nova-compute[76870]: </domain>
Oct 20 15:32:33 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1026342932',display_name='tempest-VolumesNegativeTest-instance-1026342932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1026342932',id=51,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='497a5a663c8b45b0a5eff47df128f9ca',ramdisk_id='',reservation_id='r-0o8e6mwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1589129395',owner_user_name='tempest-VolumesNegativeTest-1589129395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:32:31Z,user_data=None,user_id='273e3005f0e4434b8435ae14ef9832f7',uuid=7229e932-d2cd-4f8a-95f7-3312c6dac71a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Converting VIF {"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG os_vif [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'babd928f-9f90-553e-bf69-2e8afd5ad248', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8a588fe-22, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8a588fe-22, col_values=(('qos', UUID('b64aed67-7cce-4cac-81ae-fdeacbdc81c7')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8a588fe-22, col_values=(('external_ids', {'iface-id': 'd8a588fe-22af-448c-a252-dcf91f597bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:db:be', 'vm-uuid': '7229e932-d2cd-4f8a-95f7-3312c6dac71a'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:33 user nova-compute[76870]: INFO os_vif [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22')
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] No VIF found with MAC fa:16:3e:d6:db:be, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.neutron [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Updated VIF entry in instance network info cache for port d8a588fe-22af-448c-a252-dcf91f597bd3. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG nova.network.neutron [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Updating instance_info_cache with network_info: [{"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:32:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-98a07c16-6cf5-499b-a0cb-266270aae672 req-dc4419e7-ba52-4d42-9646-5bbe27b54a3e service nova] Releasing lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-7165c8a5-7d0a-4030-9b3d-3cc7f7146f52 req-2e1c6da1-6165-44d7-9c26-dbfbfe2631ed service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7165c8a5-7d0a-4030-9b3d-3cc7f7146f52 req-2e1c6da1-6165-44d7-9c26-dbfbfe2631ed service nova] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7165c8a5-7d0a-4030-9b3d-3cc7f7146f52 req-2e1c6da1-6165-44d7-9c26-dbfbfe2631ed service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-7165c8a5-7d0a-4030-9b3d-3cc7f7146f52 req-2e1c6da1-6165-44d7-9c26-dbfbfe2631ed service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:34 user nova-compute[76870]: DEBUG nova.compute.manager [req-7165c8a5-7d0a-4030-9b3d-3cc7f7146f52 req-2e1c6da1-6165-44d7-9c26-dbfbfe2631ed service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] No waiting events found dispatching network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:32:34 user nova-compute[76870]: WARNING nova.compute.manager [req-7165c8a5-7d0a-4030-9b3d-3cc7f7146f52 req-2e1c6da1-6165-44d7-9c26-dbfbfe2631ed service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received unexpected event network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 for instance with vm_state building and task_state spawning.
Oct 20 15:32:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:32:36 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Instance spawned successfully.
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:32:36 user nova-compute[76870]: INFO nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 20 15:32:36 user nova-compute[76870]: DEBUG nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:32:36 user nova-compute[76870]: INFO nova.compute.manager [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Took 5.85 seconds to build instance.
Oct 20 15:32:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-ea42ddbf-a2b8-4e8e-b16c-681b5c451d4f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.968s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-9dddbecd-a048-4b6e-b43c-9ebb9eab57a7 req-3dc4034f-382d-47ca-a184-a68e1669fee6 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:32:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9dddbecd-a048-4b6e-b43c-9ebb9eab57a7 req-3dc4034f-382d-47ca-a184-a68e1669fee6 service nova] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:32:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9dddbecd-a048-4b6e-b43c-9ebb9eab57a7 req-3dc4034f-382d-47ca-a184-a68e1669fee6 service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:32:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9dddbecd-a048-4b6e-b43c-9ebb9eab57a7 req-3dc4034f-382d-47ca-a184-a68e1669fee6 service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:32:37 user nova-compute[76870]: DEBUG nova.compute.manager [req-9dddbecd-a048-4b6e-b43c-9ebb9eab57a7 req-3dc4034f-382d-47ca-a184-a68e1669fee6 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] No waiting events found dispatching network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:32:37 user nova-compute[76870]: WARNING nova.compute.manager [req-9dddbecd-a048-4b6e-b43c-9ebb9eab57a7 req-3dc4034f-382d-47ca-a184-a68e1669fee6 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received unexpected event network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 for instance with vm_state active and task_state None.
Oct 20 15:32:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:50 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:50 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:32:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:32:53 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:32:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:32:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:32:53 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:32:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:32:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:17 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:18 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:33:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:33:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:33:25 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid 7229e932-d2cd-4f8a-95f7-3312c6dac71a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Updating instance_info_cache with network_info: [{"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-7229e932-d2cd-4f8a-95f7-3312c6dac71a" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk --force-share --output=json {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:33:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:33:26 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:33:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=24.921024322509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:33:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance 7229e932-d2cd-4f8a-95f7-3312c6dac71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:33:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:33:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:33:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:36 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:33:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:33:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:33:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:33:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:33:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:33:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:34:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:18 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:21 user nova-compute[76870]: INFO nova.compute.manager [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Terminating instance
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-19fba170-cac5-4bae-a87f-5e15da5302d6 req-de5bb683-9069-4abd-9147-78b50416d56a service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-vif-unplugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19fba170-cac5-4bae-a87f-5e15da5302d6 req-de5bb683-9069-4abd-9147-78b50416d56a service nova] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19fba170-cac5-4bae-a87f-5e15da5302d6 req-de5bb683-9069-4abd-9147-78b50416d56a service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-19fba170-cac5-4bae-a87f-5e15da5302d6 req-de5bb683-9069-4abd-9147-78b50416d56a service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-19fba170-cac5-4bae-a87f-5e15da5302d6 req-de5bb683-9069-4abd-9147-78b50416d56a service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] No waiting events found dispatching network-vif-unplugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.compute.manager [req-19fba170-cac5-4bae-a87f-5e15da5302d6 req-de5bb683-9069-4abd-9147-78b50416d56a service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-vif-unplugged-d8a588fe-22af-448c-a252-dcf91f597bd3 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Instance destroyed successfully.
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.objects.instance [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lazy-loading 'resources' on Instance uuid 7229e932-d2cd-4f8a-95f7-3312c6dac71a {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1026342932',display_name='tempest-VolumesNegativeTest-instance-1026342932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1026342932',id=51,image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='497a5a663c8b45b0a5eff47df128f9ca',ramdisk_id='',reservation_id='r-0o8e6mwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe361d9c-2878-4d9c-9fb8-7c063759e6e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1589129395',owner_user_name='tempest-VolumesNegativeTest-1589129395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:32:37Z,user_data=None,user_id='273e3005f0e4434b8435ae14ef9832f7',uuid=7229e932-d2cd-4f8a-95f7-3312c6dac71a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Converting VIF {"id": "d8a588fe-22af-448c-a252-dcf91f597bd3", "address": "fa:16:3e:d6:db:be", "network": {"id": "94f691ca-2319-4653-a748-2076eaa3b7d3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be3264b8c02f448d8aad2f2cd2a6d80f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a588fe-22", "ovs_interfaceid": "d8a588fe-22af-448c-a252-dcf91f597bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG os_vif [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8a588fe-22, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b64aed67-7cce-4cac-81ae-fdeacbdc81c7) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:34:21 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:21 user nova-compute[76870]: INFO os_vif [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:db:be,bridge_name='br-int',has_traffic_filtering=True,id=d8a588fe-22af-448c-a252-dcf91f597bd3,network=Network(94f691ca-2319-4653-a748-2076eaa3b7d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a588fe-22')
Oct 20 15:34:21 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Deleting instance files /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a_del
Oct 20 15:34:21 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Deletion of /opt/stack/data/nova/instances/7229e932-d2cd-4f8a-95f7-3312c6dac71a_del complete
Oct 20 15:34:22 user nova-compute[76870]: INFO nova.compute.manager [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 15:34:22 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:34:22 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:34:22 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:34:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:34:23 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Took 1.20 seconds to deallocate network for instance.
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] Acquiring lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] No waiting events found dispatching network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:34:23 user nova-compute[76870]: WARNING nova.compute.manager [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received unexpected event network-vif-plugged-d8a588fe-22af-448c-a252-dcf91f597bd3 for instance with vm_state deleted and task_state None.
Oct 20 15:34:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-e2bf5617-06ac-44dc-8c20-8eed4af1eedb req-4fde7189-9e07-4a99-a7ef-21f46383cf90 service nova] [instance: 7229e932-d2cd-4f8a-95f7-3312c6dac71a] Received event network-vif-deleted-d8a588fe-22af-448c-a252-dcf91f597bd3 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:34:23 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Deleted allocations for instance 7229e932-d2cd-4f8a-95f7-3312c6dac71a
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-5523e4db-99e2-4bea-a9a6-d57dd8dc9e6f tempest-VolumesNegativeTest-1589129395 tempest-VolumesNegativeTest-1589129395-project-member] Lock "7229e932-d2cd-4f8a-95f7-3312c6dac71a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.398s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:34:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:34:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=24.94831085205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:34:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:34:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:34:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:34:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:34:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:34:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:34:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:34:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:34:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:34:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:34:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:34:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:34:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:34:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:35:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:35:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:35:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:35:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:35:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:20 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:21 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:21 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:35:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:35:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:35:26 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:35:26 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:35:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:35:27 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:35:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=24.947269439697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:35:27 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:35:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:35:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:35:30 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:35:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:35:36 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:38 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:35:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:35:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Starting instance... {{(pid=76870) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:36:04 user nova-compute[76870]: INFO nova.compute.claims [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Claim successful on node user
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Start building networks asynchronously for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Allocating IP information in the background. {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.network.neutron [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] allocate_for_instance() {{(pid=76870) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 15:36:04 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Start building block device mappings for instance. {{(pid=76870) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 15:36:04 user nova-compute[76870]: INFO nova.virt.block_device [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Booting with volume 19034f6b-a00e-43bb-9ef8-0bede9dca05b at /dev/vda
Oct 20 15:36:04 user nova-compute[76870]: DEBUG nova.policy [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0a6ae3b428e43a691f1b0f3ed8908d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c066befc9cc340fead4c2e99c939a58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76870) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG os_brick.utils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd69fea8-ccc6-49f3-a676-3c78384b3f2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[53622eba-bd5e-47e9-a6ff-2e229431d175]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1b7f07-c1f9-45dc-963a-d54c50e9e1f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cff9b14-3a42-4748-ab6b-c6cf20b6c873]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:36:05 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:36:05 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[86adce18-104b-49de-876d-109d2e0c3691]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG os_brick.utils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating existing volume attachment record: d957a236-6a7a-40d4-9b34-f5737cf71372 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:36:05 user nova-compute[76870]: DEBUG nova.network.neutron [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Successfully created port: 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Successfully updated port: 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance cache missing network info. {{(pid=76870) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing instance network info cache due to event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance network_info: |[{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76870) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:36:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:36:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated VIF entry in instance network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:36:07 user nova-compute[76870]: DEBUG nova.network.neutron [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:36:07 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-fd2162d3-e2d2-4fe8-bf90-3862ade31da4 req-cb5c4024-62e0-49dd-aa91-56d27b226f02 service nova] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:36:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Start spawning the instance on the hypervisor. {{(pid=76870) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:36:20 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Creating image(s)
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Ensure instance console log exists: /opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Start _get_guest_xml network_info=[{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd957a236-6a7a-40d4-9b34-f5737cf71372', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa592ae5-3e10-411e-a7c6-7295c3671083', 'attached_at': '', 'detached_at': '', 'volume_id': '19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'serial': '19034f6b-a00e-43bb-9ef8-0bede9dca05b'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:36:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:36:20 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:36:20 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:36:20 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:36:20 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:36:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1623818-39dd-4cd2-a10b-137cf7fd6bc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:36:20 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2751a743-4c64-4db4-b3e0-3a9603db465f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b] added
Oct 20 15:36:20 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bce1cea-e17e-4862-9603-93e72437282f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a332a30-a081-4068-9873-5fe3ee191da2]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiCvmORN {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiCvmORN" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ab85c-6d23-43f3-a559-672b140ed89d]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiCvmORN'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31a338-4dfa-4e8f-a9e1-05687e4b276b]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:20 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d492defc-6e83-4808-afe6-be276291c8cb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 15:36:21 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 15:36:21 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:36:21 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 15:36:21 user nova-compute[76870]: 
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1179e59d-a388-4939-bb72-8f5347179a51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]
Oct 20 15:36:21 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.
Oct 20 15:36:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9394ff-7536-4d34-a783-b409c68c1cd5]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9652e-33ff-4e31-9cb8-33f4147e0f38]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:36:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:36:21 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f316f3d-1fda-4890-a0af-1b2ea9cfbec6]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:36:21 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23333666235336666', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333666235336666', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-15664508',display_name='tempest-TestShelveInstance-server-15664508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-15664508',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3YG2KeZOx2YD1UEZtLHD0HRwAiluAJ9wVyU5iAG2oKGOL2Temqwe7aBPT7kSWaGtKdGqjIxRo28AvXpbX05Q4o7LCWaAX4tkN+lp/njIs7Wsp0iJzul6d65acMAUv1Qg==',key_name='tempest-TestShelveInstance-1930216507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c066befc9cc340fead4c2e99c939a58d',ramdisk_id='',reservation_id='r-h7mumpel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-145085420',owner_user_name='tempest-TestShelveInstance-145085420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:36:05Z,user_data=None,user_id='a0a6ae3b428e43a691f1b0f3ed8908d2',uuid=aa592ae5-3e10-411e-a7c6-7295c3671083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converting VIF {"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.objects.instance [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'pci_devices' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:36:22 user nova-compute[76870]:   <uuid>aa592ae5-3e10-411e-a7c6-7295c3671083</uuid>
Oct 20 15:36:22 user nova-compute[76870]:   <name>instance-00000034</name>
Oct 20 15:36:22 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:36:22 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:36:22 user nova-compute[76870]:   <metadata>
Oct 20 15:36:22 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:36:22 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:36:22 user nova-compute[76870]:       <nova:name>tempest-TestShelveInstance-server-15664508</nova:name>
Oct 20 15:36:22 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:36:20</nova:creationTime>
Oct 20 15:36:22 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:36:22 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:36:22 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:36:22 user nova-compute[76870]:       <nova:owner>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:user uuid="a0a6ae3b428e43a691f1b0f3ed8908d2">tempest-TestShelveInstance-145085420-project-member</nova:user>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:project uuid="c066befc9cc340fead4c2e99c939a58d">tempest-TestShelveInstance-145085420</nova:project>
Oct 20 15:36:22 user nova-compute[76870]:       </nova:owner>
Oct 20 15:36:22 user nova-compute[76870]:       <nova:ports>
Oct 20 15:36:22 user nova-compute[76870]:         <nova:port uuid="94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99">
Oct 20 15:36:22 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 15:36:22 user nova-compute[76870]:         </nova:port>
Oct 20 15:36:22 user nova-compute[76870]:       </nova:ports>
Oct 20 15:36:22 user nova-compute[76870]:     </nova:instance>
Oct 20 15:36:22 user nova-compute[76870]:   </metadata>
Oct 20 15:36:22 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:36:22 user nova-compute[76870]:     <system>
Oct 20 15:36:22 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:36:22 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:36:22 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:36:22 user nova-compute[76870]:       <entry name="serial">aa592ae5-3e10-411e-a7c6-7295c3671083</entry>
Oct 20 15:36:22 user nova-compute[76870]:       <entry name="uuid">aa592ae5-3e10-411e-a7c6-7295c3671083</entry>
Oct 20 15:36:22 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:36:22 user nova-compute[76870]:     </system>
Oct 20 15:36:22 user nova-compute[76870]:   </sysinfo>
Oct 20 15:36:22 user nova-compute[76870]:   <os>
Oct 20 15:36:22 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:36:22 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:36:22 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:36:22 user nova-compute[76870]:   </os>
Oct 20 15:36:22 user nova-compute[76870]:   <features>
Oct 20 15:36:22 user nova-compute[76870]:     <acpi/>
Oct 20 15:36:22 user nova-compute[76870]:     <apic/>
Oct 20 15:36:22 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:36:22 user nova-compute[76870]:   </features>
Oct 20 15:36:22 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:36:22 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:36:22 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:36:22 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:36:22 user nova-compute[76870]:   </clock>
Oct 20 15:36:22 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:36:22 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:36:22 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:36:22 user nova-compute[76870]:   </cpu>
Oct 20 15:36:22 user nova-compute[76870]:   <devices>
Oct 20 15:36:22 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:36:22 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:36:22 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 15:36:22 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:36:22 user nova-compute[76870]:       <serial>19034f6b-a00e-43bb-9ef8-0bede9dca05b</serial>
Oct 20 15:36:22 user nova-compute[76870]:     </disk>
Oct 20 15:36:22 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:36:22 user nova-compute[76870]:       <mac address="fa:16:3e:e2:a9:43"/>
Oct 20 15:36:22 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:36:22 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:36:22 user nova-compute[76870]:       <target dev="tap94cead0d-0f"/>
Oct 20 15:36:22 user nova-compute[76870]:     </interface>
Oct 20 15:36:22 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:36:22 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083/console.log" append="off"/>
Oct 20 15:36:22 user nova-compute[76870]:     </serial>
Oct 20 15:36:22 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:36:22 user nova-compute[76870]:     <video>
Oct 20 15:36:22 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:36:22 user nova-compute[76870]:     </video>
Oct 20 15:36:22 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:36:22 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:36:22 user nova-compute[76870]:     </rng>
Oct 20 15:36:22 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:36:22 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:36:22 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:36:22 user nova-compute[76870]:     </memballoon>
Oct 20 15:36:22 user nova-compute[76870]:   </devices>
Oct 20 15:36:22 user nova-compute[76870]: </domain>
Oct 20 15:36:22 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-15664508',display_name='tempest-TestShelveInstance-server-15664508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-15664508',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3YG2KeZOx2YD1UEZtLHD0HRwAiluAJ9wVyU5iAG2oKGOL2Temqwe7aBPT7kSWaGtKdGqjIxRo28AvXpbX05Q4o7LCWaAX4tkN+lp/njIs7Wsp0iJzul6d65acMAUv1Qg==',key_name='tempest-TestShelveInstance-1930216507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c066befc9cc340fead4c2e99c939a58d',ramdisk_id='',reservation_id='r-h7mumpel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-145085420',owner_user_name='tempest-TestShelveInstance-145085420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T15:36:05Z,user_data=None,user_id='a0a6ae3b428e43a691f1b0f3ed8908d2',uuid=aa592ae5-3e10-411e-a7c6-7295c3671083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converting VIF {"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG os_vif [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b2901f0-5b88-558c-9558-8845b2cd6a9b', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94cead0d-0f, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94cead0d-0f, col_values=(('qos', UUID('17d44cda-8554-4d39-ba73-2008eae4b2b3')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94cead0d-0f, col_values=(('external_ids', {'iface-id': '94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:a9:43', 'vm-uuid': 'aa592ae5-3e10-411e-a7c6-7295c3671083'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:22 user nova-compute[76870]: INFO os_vif [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f')
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] No VIF found with MAC fa:16:3e:e2:a9:43, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:22 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-bb3e571b-557b-4594-9517-a143077b5d67 req-932cd831-aff8-4f00-93b5-73de9c614ffa service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bb3e571b-557b-4594-9517-a143077b5d67 req-932cd831-aff8-4f00-93b5-73de9c614ffa service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bb3e571b-557b-4594-9517-a143077b5d67 req-932cd831-aff8-4f00-93b5-73de9c614ffa service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-bb3e571b-557b-4594-9517-a143077b5d67 req-932cd831-aff8-4f00-93b5-73de9c614ffa service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:23 user nova-compute[76870]: DEBUG nova.compute.manager [req-bb3e571b-557b-4594-9517-a143077b5d67 req-932cd831-aff8-4f00-93b5-73de9c614ffa service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:36:23 user nova-compute[76870]: WARNING nova.compute.manager [req-bb3e571b-557b-4594-9517-a143077b5d67 req-932cd831-aff8-4f00-93b5-73de9c614ffa service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state building and task_state spawning.
Oct 20 15:36:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:36:25 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance spawned successfully.
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Found default for hw_cdrom_bus of ide {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Found default for hw_disk_bus of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Found default for hw_input_bus of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Found default for hw_pointer_model of None {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Found default for hw_video_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Found default for hw_vif_model of virtio {{(pid=76870) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 15:36:25 user nova-compute[76870]: INFO nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Took 5.02 seconds to spawn the instance on the hypervisor.
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:25 user nova-compute[76870]: INFO nova.compute.manager [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Took 21.35 seconds to build instance.
Oct 20 15:36:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-096bcc6b-b8c5-4371-a114-a861766653ff tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.452s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-477e79ab-b96c-4344-8d88-37f764aa57e9 req-d54cf645-46ad-4aec-a563-45f678ed6409 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-477e79ab-b96c-4344-8d88-37f764aa57e9 req-d54cf645-46ad-4aec-a563-45f678ed6409 service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-477e79ab-b96c-4344-8d88-37f764aa57e9 req-d54cf645-46ad-4aec-a563-45f678ed6409 service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-477e79ab-b96c-4344-8d88-37f764aa57e9 req-d54cf645-46ad-4aec-a563-45f678ed6409 service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:25 user nova-compute[76870]: DEBUG nova.compute.manager [req-477e79ab-b96c-4344-8d88-37f764aa57e9 req-d54cf645-46ad-4aec-a563-45f678ed6409 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:36:25 user nova-compute[76870]: WARNING nova.compute.manager [req-477e79ab-b96c-4344-8d88-37f764aa57e9 req-d54cf645-46ad-4aec-a563-45f678ed6409 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state active and task_state None.
Oct 20 15:36:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:28 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:28 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:36:28 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:36:29 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:36:29 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=24.944381713867188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance aa592ae5-3e10-411e-a7c6-7295c3671083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:36:29 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:36:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:36:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:36:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:36:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:36:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:02 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:37:24 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:24 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Triggering sync for uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 15:37:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:24 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:37:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:37:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:37:30 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:37:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:37:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=24.935932159423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance aa592ae5-3e10-411e-a7c6-7295c3671083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:37:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:37:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:41 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:42 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:37:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:37:47 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:52 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing instance network info cache due to event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:56 user nova-compute[76870]: INFO nova.compute.manager [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Shelve offloading
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated VIF entry in instance network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.network.neutron [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9e99e7fa-996b-4fed-b77f-ef3c26df0599 req-9cbc94ec-9aaa-4b81-9c59-5a374a9b13e2 service nova] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-28a37a7e-073c-41bf-b572-f74801fbb124 req-85d3177a-5957-4474-b3e5-5cf0cf0a7a2f service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-unplugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28a37a7e-073c-41bf-b572-f74801fbb124 req-85d3177a-5957-4474-b3e5-5cf0cf0a7a2f service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28a37a7e-073c-41bf-b572-f74801fbb124 req-85d3177a-5957-4474-b3e5-5cf0cf0a7a2f service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-28a37a7e-073c-41bf-b572-f74801fbb124 req-85d3177a-5957-4474-b3e5-5cf0cf0a7a2f service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:37:56 user nova-compute[76870]: DEBUG nova.compute.manager [req-28a37a7e-073c-41bf-b572-f74801fbb124 req-85d3177a-5957-4474-b3e5-5cf0cf0a7a2f service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-unplugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:37:56 user nova-compute[76870]: WARNING nova.compute.manager [req-28a37a7e-073c-41bf-b572-f74801fbb124 req-85d3177a-5957-4474-b3e5-5cf0cf0a7a2f service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-unplugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state active and task_state shelving.
Oct 20 15:37:57 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:57 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance destroyed successfully.
Oct 20 15:37:57 user nova-compute[76870]: DEBUG nova.compute.manager [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:37:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:37:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:37:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:37:57 user nova-compute[76870]: DEBUG nova.network.neutron [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:37:57 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:37:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance destroyed successfully.
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'resources' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T15:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-15664508',display_name='tempest-TestShelveInstance-server-15664508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-15664508',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3YG2KeZOx2YD1UEZtLHD0HRwAiluAJ9wVyU5iAG2oKGOL2Temqwe7aBPT7kSWaGtKdGqjIxRo28AvXpbX05Q4o7LCWaAX4tkN+lp/njIs7Wsp0iJzul6d65acMAUv1Qg==',key_name='tempest-TestShelveInstance-1930216507',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c066befc9cc340fead4c2e99c939a58d',ramdisk_id='',reservation_id='r-h7mumpel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-145085420',owner_user_name='tempest-TestShelveInstance-145085420-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:36:26Z,user_data=None,user_id='a0a6ae3b428e43a691f1b0f3ed8908d2',uuid=aa592ae5-3e10-411e-a7c6-7295c3671083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converting VIF {"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_vif [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94cead0d-0f, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17d44cda-8554-4d39-ba73-2008eae4b2b3) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing instance network info cache due to event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:37:58 user nova-compute[76870]: INFO os_vif [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f')
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:37:58 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dded3f-487c-4074-b3e2-cff6a9244af6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:37:58 user nova-compute[76870]: No targets found.
Oct 20 15:37:58 user nova-compute[76870]: iSNS:
Oct 20 15:37:58 user nova-compute[76870]: No targets found.
Oct 20 15:37:58 user nova-compute[76870]: STATIC:
Oct 20 15:37:58 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b
Oct 20 15:37:58 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:37:58 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:37:58 user nova-compute[76870]: FIRMWARE:
Oct 20 15:37:58 user nova-compute[76870]: No targets found.
Oct 20 15:37:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:37:58 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:37:58 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2e57e9-7659-4ccd-afbe-416c7492f233]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011424e-835c-44c4-9dfb-82531fdba84e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:37:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:37:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febf83c0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d77d93-5fe6-4d33-bac0-a66fe536d3ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[696a042c-651b-4ad9-ab48-338f3eba1c07]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f15555-c864-4a00-9872-5c8b5a07bc0c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2659d1-8b9d-4865-8686-f993809092da]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145ae56-57a5-43a9-b67d-5acb57fa87ea]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b9b4b-6912-479c-a2c1-f7a3d494084d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]
Oct 20 15:37:58 user nova-compute[76870]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.
Oct 20 15:37:58 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf4513b-a683-459a-8c9d-e39b0b88ba8f]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] <== disconnect_volume: return (294ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:37:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Deleting instance files /opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083_del
Oct 20 15:37:58 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Deletion of /opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083_del complete
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated VIF entry in instance network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.network.neutron [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": null, "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap94cead0d-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-4eb2a26d-df90-421c-880f-d8f78fdac658 req-7765f8ae-1389-4db1-8df6-bcb0c13d37b7 service nova] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-c961711f-c514-48d3-af8b-11547b67e3f5 req-abefb989-f0fe-49bd-b2ba-0cb7ccfa96ea service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c961711f-c514-48d3-af8b-11547b67e3f5 req-abefb989-f0fe-49bd-b2ba-0cb7ccfa96ea service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c961711f-c514-48d3-af8b-11547b67e3f5 req-abefb989-f0fe-49bd-b2ba-0cb7ccfa96ea service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-c961711f-c514-48d3-af8b-11547b67e3f5 req-abefb989-f0fe-49bd-b2ba-0cb7ccfa96ea service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:37:58 user nova-compute[76870]: DEBUG nova.compute.manager [req-c961711f-c514-48d3-af8b-11547b67e3f5 req-abefb989-f0fe-49bd-b2ba-0cb7ccfa96ea service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:37:58 user nova-compute[76870]: WARNING nova.compute.manager [req-c961711f-c514-48d3-af8b-11547b67e3f5 req-abefb989-f0fe-49bd-b2ba-0cb7ccfa96ea service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state active and task_state shelving.
Oct 20 15:37:59 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Deleted allocations for instance aa592ae5-3e10-411e-a7c6-7295c3671083
Oct 20 15:37:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG nova.objects.instance [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'numa_topology' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG nova.objects.base [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Object Instance<aa592ae5-3e10-411e-a7c6-7295c3671083> lazy-loaded attributes: resources,numa_topology {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.097s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:37:59 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-e4367522-956f-41c5-9c37-800dda63b291 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.338s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:38:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:01 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:01 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:38:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:05 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:38:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:38:05 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:38:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:38:23 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:23 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:38:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:38:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:38:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:38:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:38:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9064MB free_disk=24.935108184814453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:38:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:38:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:38:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:38:32 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:38:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:38:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:38:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:38:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:25 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:25 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:39:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:39:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:39:30 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:39:30 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:39:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:39:31 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:39:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9084MB free_disk=24.93460464477539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:39:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:39:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:39:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:39:33 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:39:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:33 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:43 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:44 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:39:48 user nova-compute[76870]: INFO nova.compute.manager [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Unshelving
Oct 20 15:39:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:48 user nova-compute[76870]: INFO nova.virt.block_device [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Booting with volume 19034f6b-a00e-43bb-9ef8-0bede9dca05b at /dev/vda
Oct 20 15:39:48 user nova-compute[76870]: DEBUG os_brick.utils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c3dcd8-9519-4b83-8851-a266bf077b46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:232f645be445\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e22a5c-d9cb-4527-91bd-0510e46d9dca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5216dd2a-4cd1-4875-b1df-86f9d7ef8b3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[f541356a-8352-4eb0-8022-b3df767fc871]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Running cmd (subprocess): nvme version {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] 'nvme version' failed. Not Retrying. {{(pid=76870) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.nvmeof [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] nvme not present on system {{(pid=76870) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 15:39:48 user nova-compute[76870]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 15:39:48 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[25456412-e851-482d-b4cd-48d34516215b]: (4, '') {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76870) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.lightos [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] LIGHTOS: no hostnqn found. {{(pid=76870) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG os_brick.utils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:232f645be445', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:39:48 user nova-compute[76870]: DEBUG nova.virt.block_device [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating existing volume attachment record: 9ceba0b2-3145-4e25-b617-9d557ada8665 {{(pid=76870) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 15:39:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:39:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:39:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:39:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:39:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:39:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:40:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:40:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:40:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:40:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:40:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'pci_requests' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG nova.objects.instance [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'numa_topology' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76870) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 15:40:04 user nova-compute[76870]: INFO nova.compute.claims [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Claim successful on node user
Oct 20 15:40:04 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:40:04 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:04 user nova-compute[76870]: INFO nova.network.neutron [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 15:40:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Building network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.compute.manager [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing instance network info cache due to event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.network.neutron [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Creating instance directory {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 15:40:06 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Creating image(s)
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Did not create local disks {{(pid=76870) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Ensure instance console log exists: /opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083/console.log {{(pid=76870) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Start _get_guest_xml network_info=[{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ceba0b2-3145-4e25-b617-9d557ada8665', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa592ae5-3e10-411e-a7c6-7295c3671083', 'attached_at': '', 'detached_at': '', 'volume_id': '19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'serial': '19034f6b-a00e-43bb-9ef8-0bede9dca05b'}, 'volume_type': None} {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:40:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:40:06 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] CPU controller missing on host. {{(pid=76870) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.host [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] CPU controller found on host. {{(pid=76870) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76870) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T14:26:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Flavor limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Image limits 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Flavor pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Image pref 0:0:0 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Got 1 possible topologies {{(pid=76870) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.hardware [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76870) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.objects.instance [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.objects.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Object Instance<aa592ae5-3e10-411e-a7c6-7295c3671083> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Calling os-brick to attach iSCSI Volume {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:40:06 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:40:06 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:40:06 user nova-compute[76870]: INFO os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a099cf-5f9a-45ab-8de1-038c52422a25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 15:40:06 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --interface default --op new {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8094770c-a467-42a8-abd2-635dc99d070a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b] added\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b] added
Oct 20 15:40:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b442ac5-5553-4dc5-b880-1b6d8eda38b0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b5a54e-3ec6-41b4-a755-94ab43673f5c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiCvmORN {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiCvmORN" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f66c68e-ddf7-4449-8181-99e8dc57b2ff]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiCvmORN'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff817f91-88ad-492e-b2f7-f6d598e9d0f9]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f5aae-0bf1-4b45-9401-da760be85c5f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 15:40:06 user nova-compute[76870]:  {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 15:40:06 user nova-compute[76870]:  {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:40:06 user nova-compute[76870]: WARNING os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 15:40:06 user nova-compute[76870]: 
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --login {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed91b278-ad69-4654-9449-40ffc581ae23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]
Oct 20 15:40:06 user nova-compute[76870]: Login to [iface: default, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.
Oct 20 15:40:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe38d40-f44f-4d91-b163-57c01481b1e0]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2ff1d9-c5a3-4ee1-a810-ffe5cd3e57ff]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:40:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:40:06 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Connected to 172.16.0.220:3260 {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=76870) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76870) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[80921641-e714-47dd-93ac-eca84f96d686]: (4, ('- - 0', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76870) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76870) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated VIF entry in instance network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG nova.network.neutron [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:40:06 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-9ad25a8f-a99c-434c-abb6-9baa6cb7121d req-f09e7acb-13c2-4c54-a717-4c1082d78136 service nova] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23333666235336666', 'path': '/dev/sdb'} {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333666235336666', 'path': '/dev/sdb'} {{(pid=76870) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T15:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-15664508',display_name='tempest-TestShelveInstance-server-15664508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-15664508',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1930216507',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c066befc9cc340fead4c2e99c939a58d',ramdisk_id='',reservation_id='r-h7mumpel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-145085420',owner_user_name='tempest-TestShelveInstance-145085420-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:39:48Z,user_data=None,user_id='a0a6ae3b428e43a691f1b0f3ed8908d2',uuid=aa592ae5-3e10-411e-a7c6-7295c3671083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76870) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converting VIF {"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.objects.instance [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'pci_devices' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.objects.base [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Object Instance<aa592ae5-3e10-411e-a7c6-7295c3671083> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=76870) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] End _get_guest_xml xml=<domain type="kvm">
Oct 20 15:40:07 user nova-compute[76870]:   <uuid>aa592ae5-3e10-411e-a7c6-7295c3671083</uuid>
Oct 20 15:40:07 user nova-compute[76870]:   <name>instance-00000034</name>
Oct 20 15:40:07 user nova-compute[76870]:   <memory>524288</memory>
Oct 20 15:40:07 user nova-compute[76870]:   <vcpu>1</vcpu>
Oct 20 15:40:07 user nova-compute[76870]:   <metadata>
Oct 20 15:40:07 user nova-compute[76870]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 15:40:07 user nova-compute[76870]:       <nova:package version="0.0.0"/>
Oct 20 15:40:07 user nova-compute[76870]:       <nova:name>tempest-TestShelveInstance-server-15664508</nova:name>
Oct 20 15:40:07 user nova-compute[76870]:       <nova:creationTime>2023-10-20 15:40:06</nova:creationTime>
Oct 20 15:40:07 user nova-compute[76870]:       <nova:flavor name="m1.tiny">
Oct 20 15:40:07 user nova-compute[76870]:         <nova:memory>512</nova:memory>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:disk>1</nova:disk>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:swap>0</nova:swap>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:vcpus>1</nova:vcpus>
Oct 20 15:40:07 user nova-compute[76870]:       </nova:flavor>
Oct 20 15:40:07 user nova-compute[76870]:       <nova:owner>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:user uuid="a0a6ae3b428e43a691f1b0f3ed8908d2">tempest-TestShelveInstance-145085420-project-member</nova:user>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:project uuid="c066befc9cc340fead4c2e99c939a58d">tempest-TestShelveInstance-145085420</nova:project>
Oct 20 15:40:07 user nova-compute[76870]:       </nova:owner>
Oct 20 15:40:07 user nova-compute[76870]:       <nova:ports>
Oct 20 15:40:07 user nova-compute[76870]:         <nova:port uuid="94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99">
Oct 20 15:40:07 user nova-compute[76870]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 15:40:07 user nova-compute[76870]:         </nova:port>
Oct 20 15:40:07 user nova-compute[76870]:       </nova:ports>
Oct 20 15:40:07 user nova-compute[76870]:     </nova:instance>
Oct 20 15:40:07 user nova-compute[76870]:   </metadata>
Oct 20 15:40:07 user nova-compute[76870]:   <sysinfo type="smbios">
Oct 20 15:40:07 user nova-compute[76870]:     <system>
Oct 20 15:40:07 user nova-compute[76870]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 15:40:07 user nova-compute[76870]:       <entry name="product">OpenStack Nova</entry>
Oct 20 15:40:07 user nova-compute[76870]:       <entry name="version">0.0.0</entry>
Oct 20 15:40:07 user nova-compute[76870]:       <entry name="serial">aa592ae5-3e10-411e-a7c6-7295c3671083</entry>
Oct 20 15:40:07 user nova-compute[76870]:       <entry name="uuid">aa592ae5-3e10-411e-a7c6-7295c3671083</entry>
Oct 20 15:40:07 user nova-compute[76870]:       <entry name="family">Virtual Machine</entry>
Oct 20 15:40:07 user nova-compute[76870]:     </system>
Oct 20 15:40:07 user nova-compute[76870]:   </sysinfo>
Oct 20 15:40:07 user nova-compute[76870]:   <os>
Oct 20 15:40:07 user nova-compute[76870]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 15:40:07 user nova-compute[76870]:     <boot dev="hd"/>
Oct 20 15:40:07 user nova-compute[76870]:     <smbios mode="sysinfo"/>
Oct 20 15:40:07 user nova-compute[76870]:   </os>
Oct 20 15:40:07 user nova-compute[76870]:   <features>
Oct 20 15:40:07 user nova-compute[76870]:     <acpi/>
Oct 20 15:40:07 user nova-compute[76870]:     <apic/>
Oct 20 15:40:07 user nova-compute[76870]:     <vmcoreinfo/>
Oct 20 15:40:07 user nova-compute[76870]:   </features>
Oct 20 15:40:07 user nova-compute[76870]:   <clock offset="utc">
Oct 20 15:40:07 user nova-compute[76870]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 15:40:07 user nova-compute[76870]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 15:40:07 user nova-compute[76870]:     <timer name="hpet" present="no"/>
Oct 20 15:40:07 user nova-compute[76870]:   </clock>
Oct 20 15:40:07 user nova-compute[76870]:   <cpu mode="custom" match="exact">
Oct 20 15:40:07 user nova-compute[76870]:     <model>Nehalem</model>
Oct 20 15:40:07 user nova-compute[76870]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 15:40:07 user nova-compute[76870]:   </cpu>
Oct 20 15:40:07 user nova-compute[76870]:   <devices>
Oct 20 15:40:07 user nova-compute[76870]:     <disk type="block" device="disk">
Oct 20 15:40:07 user nova-compute[76870]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 15:40:07 user nova-compute[76870]:       <source dev="/dev/sdb"/>
Oct 20 15:40:07 user nova-compute[76870]:       <target dev="vda" bus="virtio"/>
Oct 20 15:40:07 user nova-compute[76870]:       <serial>19034f6b-a00e-43bb-9ef8-0bede9dca05b</serial>
Oct 20 15:40:07 user nova-compute[76870]:     </disk>
Oct 20 15:40:07 user nova-compute[76870]:     <interface type="ethernet">
Oct 20 15:40:07 user nova-compute[76870]:       <mac address="fa:16:3e:e2:a9:43"/>
Oct 20 15:40:07 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:40:07 user nova-compute[76870]:       <mtu size="1442"/>
Oct 20 15:40:07 user nova-compute[76870]:       <target dev="tap94cead0d-0f"/>
Oct 20 15:40:07 user nova-compute[76870]:     </interface>
Oct 20 15:40:07 user nova-compute[76870]:     <serial type="pty">
Oct 20 15:40:07 user nova-compute[76870]:       <log file="/opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083/console.log" append="off"/>
Oct 20 15:40:07 user nova-compute[76870]:     </serial>
Oct 20 15:40:07 user nova-compute[76870]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 15:40:07 user nova-compute[76870]:     <video>
Oct 20 15:40:07 user nova-compute[76870]:       <model type="virtio"/>
Oct 20 15:40:07 user nova-compute[76870]:     </video>
Oct 20 15:40:07 user nova-compute[76870]:     <rng model="virtio">
Oct 20 15:40:07 user nova-compute[76870]:       <backend model="random">/dev/urandom</backend>
Oct 20 15:40:07 user nova-compute[76870]:     </rng>
Oct 20 15:40:07 user nova-compute[76870]:     <controller type="usb" index="0" model="none"/>
Oct 20 15:40:07 user nova-compute[76870]:     <memballoon model="virtio">
Oct 20 15:40:07 user nova-compute[76870]:       <stats period="10"/>
Oct 20 15:40:07 user nova-compute[76870]:     </memballoon>
Oct 20 15:40:07 user nova-compute[76870]:   </devices>
Oct 20 15:40:07 user nova-compute[76870]: </domain>
Oct 20 15:40:07 user nova-compute[76870]:  {{(pid=76870) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T15:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-15664508',display_name='tempest-TestShelveInstance-server-15664508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-15664508',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1930216507',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c066befc9cc340fead4c2e99c939a58d',ramdisk_id='',reservation_id='r-h7mumpel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-145085420',owner_user_name='tempest-TestShelveInstance-145085420-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:39:48Z,user_data=None,user_id='a0a6ae3b428e43a691f1b0f3ed8908d2',uuid=aa592ae5-3e10-411e-a7c6-7295c3671083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converting VIF {"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG os_vif [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b2901f0-5b88-558c-9558-8845b2cd6a9b', '_type': 'linux-noop'}}, row=False) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94cead0d-0f, may_exist=True, interface_attrs={}) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94cead0d-0f, col_values=(('qos', UUID('1f81d4f4-6773-457d-9319-6b66786ebc94')),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94cead0d-0f, col_values=(('external_ids', {'iface-id': '94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:a9:43', 'vm-uuid': 'aa592ae5-3e10-411e-a7c6-7295c3671083'}),), if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:40:07 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:07 user nova-compute[76870]: INFO os_vif [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f')
Oct 20 15:40:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] No BDM found with device name vda, not building metadata. {{(pid=76870) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 15:40:08 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] No VIF found with MAC fa:16:3e:e2:a9:43, not building metadata {{(pid=76870) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-caa15c93-324f-4984-978a-965556d1eb7c req-b7cffd43-25d8-46dc-a721-44df1298324f service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-caa15c93-324f-4984-978a-965556d1eb7c req-b7cffd43-25d8-46dc-a721-44df1298324f service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-caa15c93-324f-4984-978a-965556d1eb7c req-b7cffd43-25d8-46dc-a721-44df1298324f service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-caa15c93-324f-4984-978a-965556d1eb7c req-b7cffd43-25d8-46dc-a721-44df1298324f service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG nova.compute.manager [req-caa15c93-324f-4984-978a-965556d1eb7c req-b7cffd43-25d8-46dc-a721-44df1298324f service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:40:09 user nova-compute[76870]: WARNING nova.compute.manager [req-caa15c93-324f-4984-978a-965556d1eb7c req-b7cffd43-25d8-46dc-a721-44df1298324f service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 15:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance event wait completed in 0 seconds for  {{(pid=76870) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Guest created on hypervisor {{(pid=76870) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 15:40:11 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance spawned successfully.
Oct 20 15:40:11 user nova-compute[76870]: DEBUG nova.compute.manager [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Checking state {{(pid=76870) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-648680f4-b4eb-4fa6-b2e2-b7914267a2b4 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.960s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-ef602887-1fb6-47c3-b8b8-9bdb174773ee req-266df17a-29d0-4ccb-9d88-b9883d91cdff service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ef602887-1fb6-47c3-b8b8-9bdb174773ee req-266df17a-29d0-4ccb-9d88-b9883d91cdff service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ef602887-1fb6-47c3-b8b8-9bdb174773ee req-266df17a-29d0-4ccb-9d88-b9883d91cdff service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-ef602887-1fb6-47c3-b8b8-9bdb174773ee req-266df17a-29d0-4ccb-9d88-b9883d91cdff service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:11 user nova-compute[76870]: DEBUG nova.compute.manager [req-ef602887-1fb6-47c3-b8b8-9bdb174773ee req-266df17a-29d0-4ccb-9d88-b9883d91cdff service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:40:11 user nova-compute[76870]: WARNING nova.compute.manager [req-ef602887-1fb6-47c3-b8b8-9bdb174773ee req-266df17a-29d0-4ccb-9d88-b9883d91cdff service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state active and task_state None.
Oct 20 15:40:12 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:17 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:22 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:26 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:26 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:40:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:27 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:27 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:40:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:40:31 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:31 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:40:31 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:40:32 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:40:32 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=24.93307876586914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance aa592ae5-3e10-411e-a7c6-7295c3671083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:40:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:37 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:43 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:40:48 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:53 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:40:58 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:03 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:41:08 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:13 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:18 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:23 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:28 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:28 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:28 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:41:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:32 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:32 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:41:32 user nova-compute[76870]: DEBUG nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76870) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:41:33 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.932456970214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Instance aa592ae5-3e10-411e-a7c6-7295c3671083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76870) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:41:33 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Forcefully refreshing network info cache for instance {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lazy-loading 'info_cache' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG nova.network.neutron [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated the network info_cache for instance {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:37 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG nova.compute.manager [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG nova.compute.manager [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing instance network info cache due to event network-changed-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] Acquiring lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] Acquired lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 15:41:38 user nova-compute[76870]: DEBUG nova.network.neutron [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Refreshing network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:39 user nova-compute[76870]: INFO nova.compute.manager [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Terminating instance
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Start destroying the instance on the hypervisor. {{(pid=76870) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updated VIF entry in instance network info cache for port 94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99. {{(pid=76870) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.network.neutron [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [{"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-2ef666ff-56f9-4403-9d06-a9f596a8ef7c req-4e6400b0-eefc-4987-b1e7-b6d8009a7889 service nova] Releasing lock "refresh_cache-aa592ae5-3e10-411e-a7c6-7295c3671083" {{(pid=76870) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-284f7de5-41e4-4b30-b551-a8204ef3575e req-d279dea5-a0d7-4761-a7a5-ea5109418a70 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-unplugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-284f7de5-41e4-4b30-b551-a8204ef3575e req-d279dea5-a0d7-4761-a7a5-ea5109418a70 service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-284f7de5-41e4-4b30-b551-a8204ef3575e req-d279dea5-a0d7-4761-a7a5-ea5109418a70 service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-284f7de5-41e4-4b30-b551-a8204ef3575e req-d279dea5-a0d7-4761-a7a5-ea5109418a70 service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-284f7de5-41e4-4b30-b551-a8204ef3575e req-d279dea5-a0d7-4761-a7a5-ea5109418a70 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-unplugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.compute.manager [req-284f7de5-41e4-4b30-b551-a8204ef3575e req-d279dea5-a0d7-4761-a7a5-ea5109418a70 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-unplugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with task_state deleting. {{(pid=76870) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 15:41:39 user nova-compute[76870]: INFO nova.virt.libvirt.driver [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Instance destroyed successfully.
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.objects.instance [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lazy-loading 'resources' on Instance uuid aa592ae5-3e10-411e-a7c6-7295c3671083 {{(pid=76870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.vif [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T15:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-15664508',display_name='tempest-TestShelveInstance-server-15664508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-15664508',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3YG2KeZOx2YD1UEZtLHD0HRwAiluAJ9wVyU5iAG2oKGOL2Temqwe7aBPT7kSWaGtKdGqjIxRo28AvXpbX05Q4o7LCWaAX4tkN+lp/njIs7Wsp0iJzul6d65acMAUv1Qg==',key_name='tempest-TestShelveInstance-1930216507',keypairs=<?>,launch_index=0,launched_at=2023-10-20T15:40:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c066befc9cc340fead4c2e99c939a58d',ramdisk_id='',reservation_id='r-h7mumpel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-145085420',owner_user_name='tempest-TestShelveInstance-145085420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T15:40:11Z,user_data=None,user_id='a0a6ae3b428e43a691f1b0f3ed8908d2',uuid=aa592ae5-3e10-411e-a7c6-7295c3671083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converting VIF {"id": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "address": "fa:16:3e:e2:a9:43", "network": {"id": "2579dc0c-09d1-4bdf-8c02-77e0fa404d72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1805803089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c066befc9cc340fead4c2e99c939a58d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94cead0d-0f", "ovs_interfaceid": "94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.network.os_vif_util [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_vif [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f') {{(pid=76870) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94cead0d-0f, bridge=br-int, if_exists=True) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f81d4f4-6773-457d-9319-6b66786ebc94) {{(pid=76870) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:39 user nova-compute[76870]: INFO os_vif [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:a9:43,bridge_name='br-int',has_traffic_filtering=True,id=94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99,network=Network(2579dc0c-09d1-4bdf-8c02-77e0fa404d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94cead0d-0f')
Oct 20 15:41:39 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] calling os-brick to detach iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fec2c235ae0>, {'target_iqn': 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiCvmORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 15:41:39 user nova-compute[76870]: WARNING os_brick.initiator.connectors.base [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67ebf2c-e757-451d-9bc7-d497d25bfdc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 15:41:39 user nova-compute[76870]: No targets found.
Oct 20 15:41:39 user nova-compute[76870]: iSNS:
Oct 20 15:41:39 user nova-compute[76870]: No targets found.
Oct 20 15:41:39 user nova-compute[76870]: STATIC:
Oct 20 15:41:39 user nova-compute[76870]: Target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b
Oct 20 15:41:39 user nova-compute[76870]:         Portal: 172.16.0.220:3260,-1
Oct 20 15:41:39 user nova-compute[76870]:                 Iface Name: default
Oct 20 15:41:39 user nova-compute[76870]: FIRMWARE:
Oct 20 15:41:39 user nova-compute[76870]: No targets found.
Oct 20 15:41:39 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 15:41:39 user nova-compute[76870]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 15:41:39 user nova-compute[76870]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76870) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b', 0)] {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f1ff6-fc8d-40ae-8771-40994fafd633]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db80c6d-e37a-4aa1-bef1-3eec3a35c143]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:41:39 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b (non-flash)
Oct 20 15:41:39 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fec1c69a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b'): ({'sdb'}, set())}) {{(pid=76870) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Removing single pathed devices sdb {{(pid=76870) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c6d371-384b-4801-9f11-627311a66385]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffe172-8c63-49ba-92c1-7f34fb16de38]: (4, ('ok\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Flushing IO for device /dev/sdb {{(pid=76870) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba3200-1966-444d-84a5-899b5b8a2b1c]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76870) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eba0fd-50e9-4297-a34b-06cd8fef1597]: (4, ('1', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.linuxscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] SCSI volumes sdb have been removed. {{(pid=76870) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_53810ef3', '/dev/disk/by-id/scsi-1SCST_BIO53810ef3-33fb53ff1070c729', '/dev/disk/by-id/scsi-23333666235336666') {{(pid=87639) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1f0c4a-4e62-48cd-b377-7c3bb5d7400f]: (4, None) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b')] {{(pid=76870) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 15:41:39 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[69013de4-34f5-45b6-a9a7-6ee4c3b4f835]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --logout {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2a129f-43f8-46b2-a7ac-d55b9c590c4a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260]
Oct 20 15:41:40 user nova-compute[76870]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b, portal: 172.16.0.220,3260] successful.
Oct 20 15:41:40 user nova-compute[76870]:  stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op delete {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19034f6b-a00e-43bb-9ef8-0bede9dca05b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9ec419-a995-4928-97f4-513dbd6390eb]: (4, ('', '')) {{(pid=87639) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76870) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.base [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] <== disconnect_volume: return (296ms) None {{(pid=76870) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Disconnected iSCSI Volume {{(pid=76870) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 15:41:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Deleting instance files /opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083_del
Oct 20 15:41:40 user nova-compute[76870]: INFO nova.virt.libvirt.driver [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Deletion of /opt/stack/data/nova/instances/aa592ae5-3e10-411e-a7c6-7295c3671083_del complete
Oct 20 15:41:40 user nova-compute[76870]: INFO nova.compute.manager [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 20 15:41:40 user nova-compute[76870]: DEBUG oslo.service.loopingcall [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76870) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG nova.compute.manager [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Deallocating network for instance {{(pid=76870) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] deallocate_for_instance() {{(pid=76870) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG nova.network.neutron [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Updating instance_info_cache with network_info: [] {{(pid=76870) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 15:41:40 user nova-compute[76870]: INFO nova.compute.manager [-] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Took 0.49 seconds to deallocate network for instance.
Oct 20 15:41:40 user nova-compute[76870]: DEBUG nova.compute.manager [req-c91b1501-ad7c-40b2-9c0d-e8eae3e1d45e req-fb755b2b-9754-4042-9ef3-9549c3740a3d service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-deleted-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:41:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-3eee8ee1-56cf-485e-9ea3-5a783a116cff req-804da6cc-c953-4da0-82e0-0c599ad2c9e6 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3eee8ee1-56cf-485e-9ea3-5a783a116cff req-804da6cc-c953-4da0-82e0-0c599ad2c9e6 service nova] Acquiring lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3eee8ee1-56cf-485e-9ea3-5a783a116cff req-804da6cc-c953-4da0-82e0-0c599ad2c9e6 service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [req-3eee8ee1-56cf-485e-9ea3-5a783a116cff req-804da6cc-c953-4da0-82e0-0c599ad2c9e6 service nova] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG nova.compute.manager [req-3eee8ee1-56cf-485e-9ea3-5a783a116cff req-804da6cc-c953-4da0-82e0-0c599ad2c9e6 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] No waiting events found dispatching network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 {{(pid=76870) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 15:41:41 user nova-compute[76870]: WARNING nova.compute.manager [req-3eee8ee1-56cf-485e-9ea3-5a783a116cff req-804da6cc-c953-4da0-82e0-0c599ad2c9e6 service nova] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Received unexpected event network-vif-plugged-94cead0d-0f6b-4abf-a4fb-b5ddf16e1f99 for instance with vm_state active and task_state deleting.
Oct 20 15:41:41 user nova-compute[76870]: INFO nova.compute.manager [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Took 0.90 seconds to detach 1 volumes for instance.
Oct 20 15:41:41 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] [instance: aa592ae5-3e10-411e-a7c6-7295c3671083] Deleting volume: 19034f6b-a00e-43bb-9ef8-0bede9dca05b {{(pid=76870) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:41 user nova-compute[76870]: INFO nova.scheduler.client.report [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Deleted allocations for instance aa592ae5-3e10-411e-a7c6-7295c3671083
Oct 20 15:41:41 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b59fe84c-9f04-4861-92e0-621adcc049d5 tempest-TestShelveInstance-145085420 tempest-TestShelveInstance-145085420-project-member] Lock "aa592ae5-3e10-411e-a7c6-7295c3671083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:41:44 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:45 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:41:49 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:41:54 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:41:59 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:04 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:42:09 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:14 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:42:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:42:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:42:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:42:19 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:29 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:29 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:42:29 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:32 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:34 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:42:34 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:42:34 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:35 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:42:35 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=24.93136215209961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing inventories for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating ProviderTree inventory for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Updating inventory in ProviderTree for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing aggregate associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, aggregates: None {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Refreshing trait associations for resource provider 66693f9b-2ec0-4a94-af95-90fe75f25c06, traits: COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76870) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:42:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:42:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:42:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:42:39 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:42:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:42 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:48 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:42:50 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:42:55 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:43:00 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:05 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:07 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:07 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76870) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 15:43:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:43:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76870) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 15:43:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:43:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76870) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 15:43:10 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:15 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:15 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Cleaning up deleted instances {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 15:43:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] There are 1 instances to clean {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 15:43:15 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] [instance: a734d0c6-9dff-4254-9231-040de2c5eacc] Instance has had 5 of 5 cleanup attempts {{(pid=76870) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 20 15:43:20 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:43:24 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:25 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:30 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 15:43:30 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:31 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:31 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76870) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 15:43:32 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:35 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:43:35 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:43:35 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:43:35 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Auditing locally available compute resources for user (node: user) {{(pid=76870) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 15:43:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:43:36 user nova-compute[76870]: WARNING nova.virt.libvirt.driver [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 15:43:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Hypervisor/Node resource view: name=user free_ram=9194MB free_disk=24.924591064453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76870) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76870) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG nova.compute.provider_tree [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed in ProviderTree for provider: 66693f9b-2ec0-4a94-af95-90fe75f25c06 {{(pid=76870) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG nova.scheduler.client.report [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Inventory has not changed for provider 66693f9b-2ec0-4a94-af95-90fe75f25c06 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76870) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG nova.compute.resource_tracker [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Compute_service record updated for user:user {{(pid=76870) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 15:43:36 user nova-compute[76870]: DEBUG oslo_concurrency.lockutils [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=76870) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 15:43:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:39 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:40 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:43:40 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 15:43:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Starting heal instance info cache {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 15:43:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Rebuilding the list of instances to heal {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 15:43:40 user nova-compute[76870]: DEBUG nova.compute.manager [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Didn't find any instances for network info cache update. {{(pid=76870) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 15:43:45 user nova-compute[76870]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76870) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 15:43:46 user nova-compute[76870]: DEBUG oslo_service.periodic_task [None req-b7cb2c6d-9b41-4f92-9e2b-304db2620830 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76870) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}